Semiconductor & Computer Engineering
(Undo revision 101905 by 204.128.73.52 (talk)) |
|||
| (11 intermediate revisions by 8 users not shown) | |||
| Line 24: | Line 24: | ||
|core count=12 | |core count=12 | ||
|thread count=12 | |thread count=12 | ||
| + | |max memory=8 GiB | ||
|tdp=36 W | |tdp=36 W | ||
|package name 1=tesla_car,fcbga_2116 | |package name 1=tesla_car,fcbga_2116 | ||
}} | }} | ||
| − | '''Full Self-Driving Chip''' ('''FSD Chip''', previously '''Autopilot Hardware 3.0''') is an [[autonomous driving chip]] designed by [[tesla car|Tesla]] and introduced in early [[2019]] for their own cars. Tesla claims the chip is aimed at [[SAE levels|autonomous levels 4 and 5]]. Fabricated on [[Samsung]]'s [[14 nm process technology]], the FSD Chip incorporates 3 quad-core {{armh|Cortex-A72|l=arch}} clusters for a total of 12 CPUs operating at 2.2 GHz, a GPU operating 1 GHz, 2 [[neural processing units]] operating at 2 GHz, and various other hardware accelerators. The FSD supports up to 128-bit LPDDR4-4266 memory. | + | '''Full Self-Driving Chip''' ('''FSD Chip''', previously '''Autopilot Hardware 3.0''') is an [[autonomous driving chip]] designed by [[tesla car|Tesla]] and introduced in early [[2019]] for their own cars. Tesla claims the chip is aimed at [[SAE levels|autonomous levels 4 and 5]]. Fabricated on [[Samsung]]'s [[14 nm process technology]], the FSD Chip incorporates 3 quad-core {{armh|Cortex-A72|l=arch}} clusters for a total of 12 CPUs operating at 2.2 GHz, a Mali G71 MP12 GPU operating 1 GHz, 2 [[neural processing units]] operating at 2 GHz, and various other hardware accelerators. The FSD supports up to 128-bit LPDDR4-4266 memory. |
== History == | == History == | ||
| Line 36: | Line 37: | ||
The full self-driving chip or FSD chip for short is [[tesla car|Tesla's]] home-grown custom designed [[autonomous driving chip]]. The chip has been in development since [[2016]] and has entered mass production in early [[2019]]. Designed as a drop-in upgrade for Tesla's existing cars, the FSD chip inherits most of the power and thermal requirements of prior solutions - including staying with the maximum power consumption of 100 W. Since the chip itself is designed specifically for Tesla's own cars and their own requirements, much of the general purpose-ability of alternative [[neural processors]] has been stripped away from the FSD chip, leaving the design with only the hardware they need. | The full self-driving chip or FSD chip for short is [[tesla car|Tesla's]] home-grown custom designed [[autonomous driving chip]]. The chip has been in development since [[2016]] and has entered mass production in early [[2019]]. Designed as a drop-in upgrade for Tesla's existing cars, the FSD chip inherits most of the power and thermal requirements of prior solutions - including staying with the maximum power consumption of 100 W. Since the chip itself is designed specifically for Tesla's own cars and their own requirements, much of the general purpose-ability of alternative [[neural processors]] has been stripped away from the FSD chip, leaving the design with only the hardware they need. | ||
| − | At a high level, the chip is a full [[system-on-a-chip | + | At a high level, the chip is a full [[system-on-a-chip]] capable of booting a standard operating system. It is manufactured on Samsung's [[14-nanometer process]] at their Austin, Texas fab, packing roughly six billion transistors on a 260 millimeter squared silicon die. The FSD chip meets AEC-Q100 Grade-2 automotive quality standards. The choice to go with a mature [[14 nm]] node instead of a more [[technology node|leading-edge node]] boiled down to cost and IP readiness. There are twelve {{arch|64}} [[ARM]] cores organized as three clusters of quad-core {{armh|Cortex-A72|l=arch}} cores operating at 2.2 GHz which are used for general purpose processing. There is also relatively light GPU primarily designed for light-weight post-processing. It operates at 1 GHz, capable of up to 600 GFLOPS, supporting both [[single-precision]] and [[double-precision]] floating point operations. |
The chip features a relatively low-cost conventional memory subsystem supporting 128-bit of LPDDR4 memory operating at 2133 MHz. | The chip features a relatively low-cost conventional memory subsystem supporting 128-bit of LPDDR4 memory operating at 2133 MHz. | ||
| Line 85: | Line 86: | ||
* 2 x DMA operations for reading and writing to main memory | * 2 x DMA operations for reading and writing to main memory | ||
| − | * 3x dot-product instructions (convolution, deconvolution, and | + | * 3x dot-product instructions (convolution, deconvolution, and inner-product) |
* scale (1-input, 1-output) | * scale (1-input, 1-output) | ||
* eltwise (2-input, 1-output) | * eltwise (2-input, 1-output) | ||
| Line 96: | Line 97: | ||
|type=LPDDR4-4266 | |type=LPDDR4-4266 | ||
|ecc=Yes | |ecc=Yes | ||
| + | |max mem=8 GiB | ||
|controllers=1 | |controllers=1 | ||
|width=128 bits | |width=128 bits | ||
| Line 108: | Line 110: | ||
=== Operation === | === Operation === | ||
| − | When powered on and engaged, sensory input is fed to the board from a variety of sources. Those include current car readings such as inertial measurement unit (IMU), radar, GPS, ultrasonic sensors, wheel ticks, steering angle, and maps data. There are 8 vision cameras and 12 ultrasonic sensors. Data is fed to both FSD chips simultaneously for processing. The two chips independently form a future plan for the car - a detailed plan of what the car should do next. The two independently derived plans from both chips are then consequently sent to the safety system which compares them to ensure an agreement was reached. Once the two plans from both chips agree on the calculated plan, the car can proceed and act on that plan (i.e., operate the actuators). The drive commands are then validated and sensory information is used as feedback for ensuring the commands executed the desired operations. The full operation loop operates continuously at a high frame rate. | + | When powered on and engaged, sensory input is fed to the board from a variety of sources. Those include current car readings such as inertial measurement unit (IMU), radar, GPS, ultrasonic sensors, wheel ticks, steering angle, and maps data. There are 8 external vision cameras (and 1 internal camera on some vehicles) and 12 ultrasonic sensors. Data is fed to both FSD chips simultaneously for processing. The two chips independently form a future plan for the car - a detailed plan of what the car should do next. The two independently derived plans from both chips are then consequently sent to the safety system which compares them to ensure an agreement was reached. Once the two plans from both chips agree on the calculated plan, the car can proceed and act on that plan (i.e., operate the actuators). The drive commands are then validated and sensory information is used as feedback for ensuring the commands executed the desired operations. The full operation loop operates continuously at a high frame rate. |
== Power == | == Power == | ||
| − | Running the full software stack, the FSD computer dissipates 72 Watts. This is roughly 25% more than the 57 Watts the prior solution, HW2.5, dissipated. Off the 72 W, this includes 15 W which is dissipated by the NPUs. Compared to the HW2.5, running the exact software stack and sensors, Tesla reported a 21x improvement in frames per second | + | Running the full software stack, the FSD computer dissipates 72 Watts. This is roughly 25% more than the 57 Watts the prior solution, HW2.5, dissipated. Off the 72 W, this includes 15 W which is dissipated by the NPUs. Compared to the HW2.5, running the exact software stack and sensors, Tesla reported a 21x improvement in frames per second. |
{| class="wikitable" | {| class="wikitable" | ||
| Line 190: | Line 192: | ||
== Bibliography == | == Bibliography == | ||
| + | * Tesla, ''personal communication'', April 25, 2019 | ||
* ''Tesla Autonomy Day'', April 22, 2019 | * ''Tesla Autonomy Day'', April 22, 2019 | ||
| − | * Tesla | + | * {{bib|hc|31|Tesla}} |
Latest revision as of 19:34, 16 September 2023
| Edit Values | |
| FSD Chip | |
 | |
 | |
| General Info | |
| Designer | Tesla (car company) |
| Manufacturer | Samsung |
| Market | Automotive |
| Introduction | April 22, 2019 (announced) March 10, 2019 (launched) |
| General Specs | |
| Frequency | 2,200 MHz |
| Microarchitecture | |
| ISA | ARMv8.0-A (ARM) |
| Microarchitecture | Cortex-A72 |
| Core Name | Cortex-A72 |
| Core Stepping | B0 |
| Process | 14 nm |
| Transistors | 6,000,000,000 |
| Technology | CMOS |
| Die | 260 mm² 20 mm × 13 mm |
| Word Size | 64 bit |
| Cores | 12 |
| Threads | 12 |
| Max Memory | 8 GiB |
| Electrical | |
| TDP | 36 W |
| Packaging | |
| Package | FCBGA-2116 (BGA) |
| Dimension | 37.5 mm × 37.5 mm |
| Contacts | 2116 |
Full Self-Driving Chip (FSD Chip, previously Autopilot Hardware 3.0) is an autonomous driving chip designed by Tesla and introduced in early 2019 for their own cars. Tesla claims the chip is aimed at autonomous levels 4 and 5. Fabricated on Samsung's 14 nm process technology, the FSD Chip incorporates 3 quad-core Cortex-A72 clusters for a total of 12 CPUs operating at 2.2 GHz, a Mali G71 MP12 GPU operating 1 GHz, 2 neural processing units operating at 2 GHz, and various other hardware accelerators. The FSD supports up to 128-bit LPDDR4-4266 memory.
Contents
History[edit]
Design and planning for the FSD chip started in 2016 when Tesla claims they saw no alternative solution that fits their problem of addressing autonomous driving. The FSD chip project was led by Jim Keller and Pete Bannon among other architects. The design team was formed in February 2016. Development was done over the course of 18 months. In August 2017, the chip was released for manufacturing with first silicon coming back in December 2017 fully working. A number of additional modifications were done to the design, requiring respinning. B0 stepping was released to manufacturing in April 2018. Full production of B0 started shortly after qualifications in July 2018. In December 2018, Tesla started retrofitting employee cars with the new hardware and software stack. In March 2019, Tesla began volume shipping the FSD chip and computer in their Model S and Model X cars. Production shipment in the Tesla Model 3 started in April 2019.
Overview[edit]
The full self-driving chip or FSD chip for short is Tesla's home-grown custom designed autonomous driving chip. The chip has been in development since 2016 and has entered mass production in early 2019. Designed as a drop-in upgrade for Tesla's existing cars, the FSD chip inherits most of the power and thermal requirements of prior solutions - including staying with the maximum power consumption of 100 W. Since the chip itself is designed specifically for Tesla's own cars and their own requirements, much of the general purpose-ability of alternative neural processors has been stripped away from the FSD chip, leaving the design with only the hardware they need.
At a high level, the chip is a full system-on-a-chip capable of booting a standard operating system. It is manufactured on Samsung's 14-nanometer process at their Austin, Texas fab, packing roughly six billion transistors on a 260 millimeter squared silicon die. The FSD chip meets AEC-Q100 Grade-2 automotive quality standards. The choice to go with a mature 14 nm node instead of a more leading-edge node boiled down to cost and IP readiness. There are twelve 64-bit ARM cores organized as three clusters of quad-core Cortex-A72 cores operating at 2.2 GHz which are used for general purpose processing. There is also relatively light GPU primarily designed for light-weight post-processing. It operates at 1 GHz, capable of up to 600 GFLOPS, supporting both single-precision and double-precision floating point operations.
The chip features a relatively low-cost conventional memory subsystem supporting 128-bit of LPDDR4 memory operating at 2133 MHz.
| Component | GPU | NPU |
|---|---|---|
| Amount | 1 | 2 |
| Peak Performance | 600 GFLOPS (FP32, FP64) |
36.86 TOPS (Int8) |
| Total Peak Performance | 600 GFLOPS | 73.73 TOPS |
Safety system[edit]
There is a safety system that incorporates a dual-core lockstep CPU which conducts the final arbitration of the car actuators. This CPU determines if the two plans generated by the two FSD chips on the FSD computer match and if it's safe to drive the actuators (See also § Operation).
Security system[edit]
The security system is designed to ensure the chip only executes code that has been cryptographically-signed by Tesla.
Camera serial interface[edit]
The FSD chip has a camera serial interface (CSI) capable of up to 2.5 billion pixels per second from the various video input devices for processing.
Video Encoder[edit]
The FSD chip integrates an H.265 (HEVC) video encoder which is used for various applications such as the back up camera display, dash cam, and cloud clip-logging.
Image signal processor[edit]
The FSD incorporates an image signal processor (ISP) with an internal 24-bit pipeline designed to process the eight HDR sensors equipped on Tesla cars and is capable of processing up to a billion pixels per second. The ISP has tone mapping capabilities, allowing the chip to expose additional details due to bright/dark spots such as shadows. Additionally, the ISP has noise reduction capabilities.
Neural processing unit[edit]
The FSD chip integrates two custom-designed neural processing units. Each NPU packs 32 MiB of SRAM designed for storing temporary network results, reducing data movements to main memory. The overall design is pretty straightforward. Each cycle, 256 bytes of activation data and an additional 128 bytes of weight data is read from the SRAM into the MACs array where they are combined. Each NPU has a 96x96 multiply-accumulate array for a total of 9,216 MACs and 18,432 operations. For the FSD chip, Tesla uses an 8-bit by 8-bit integer multiply and a 32-bit integer addition. The choices for both data types is largely driven by their effort to reduce the power consumption (e.g., a 32-bit FP addition consumes roughly 9 times as much as a 32-bit integer addition) Operating at 2 GHz, each NPU has a peak performance of 36.86 trillion operations per second (TOPS). With two NPUs on each chip, the FSD chip is capable of up to 73.7 trillion operations per second of combined peak performance. Following the dot product operation, data is shifted to the activation hardware, the pooling hardware, and finally into the write buffer which aggregates the results. The FSD supports a number of activation functions, including a rectified linear unit (ReLU), Sigmoid Linear Unit (SiLU), and TanH. Each cycle, 128 bytes of result data is written back to the SRAM. All the operations are done simultaneously and continuously, repeating until the full network is done.
_(annotated).png)
Some of the hardware has been simplified which puts the complexity onto the software. This was done to reduce the cost of silicon in favor of slightly more complex software. The software can map and allocate individual SRAM banks. With the help of Tesla's NN compiler, layer fusion is also done, allowing data reuse by coupling conv-scale-act-pooling operations. The compiler also performs layer smoothing, ensuring consistent memory accesses, adds channel padding designed to reduce bank conflicts, and inserts DMA operations to prefetch data prior to use. During code generation, weight data is generated, code is compressed, and a CRC checksum is generated for reliability.
Under normal operation, the neural network program is loaded at the start and is kept in memory for the entire duration in which the chip is powered. Running is done by setting the input buffers address (e.g., newly taken image sensor photo), setting the output buffer address, and weight buffer address (e.g., network weights), set the program address, and run. The NPU will asynchronously run on its own the entire neural network model until reaching a stop instruction which triggers an interrupt, letting the CPU post-process the results.
Instruction set[edit]
The NPU includes a small instruction set to efficiently process convolutional neural networks.
- 2 x DMA operations for reading and writing to main memory
- 3x dot-product instructions (convolution, deconvolution, and inner-product)
- scale (1-input, 1-output)
- eltwise (2-input, 1-output)
- stop to half processing.
Memory controller[edit]
 |
Integrated Memory Controller
|
|||||||||||
|
||||||||||||
Full self-driving computer (FSD Computer)[edit]
The FSD computer is designed to be retrofitted into existing Tesla models and is therefore largely the same in terms of form factor and I/O. The computer itself fits just behind the glove compartment of the car. The FSD Computer can be installed by a technician in the same slot as the prior Autopilot Hardware 2.5 board. The board itself incorporates two fully independent FSD chips along with their own power subsystem, DRAM, and flash memory for full redundancy. Each chip boots up from its own storage memory and runs its own independent operating system. On the right of the board (shown below) are the eight camera connectors. The power supply and controls are on the left side of the board. The board sits on two independent power supplies - one for one of the FSD chips and one for the other. Additionally, half of the cameras sit on one power supply and the other half sit on the second power supply (note that the video input itself is received by both chips). The redundancy is designed to ensure that in the case of a component such as a camera stream or power supply or some other IC on the board going bad, the full system can continue to operate normally.
Operation[edit]
When powered on and engaged, sensory input is fed to the board from a variety of sources. Those include current car readings such as inertial measurement unit (IMU), radar, GPS, ultrasonic sensors, wheel ticks, steering angle, and maps data. There are 8 external vision cameras (and 1 internal camera on some vehicles) and 12 ultrasonic sensors. Data is fed to both FSD chips simultaneously for processing. The two chips independently form a future plan for the car - a detailed plan of what the car should do next. The two independently derived plans from both chips are then consequently sent to the safety system which compares them to ensure an agreement was reached. Once the two plans from both chips agree on the calculated plan, the car can proceed and act on that plan (i.e., operate the actuators). The drive commands are then validated and sensory information is used as feedback for ensuring the commands executed the desired operations. The full operation loop operates continuously at a high frame rate.
Power[edit]
Running the full software stack, the FSD computer dissipates 72 Watts. This is roughly 25% more than the 57 Watts the prior solution, HW2.5, dissipated. Off the 72 W, this includes 15 W which is dissipated by the NPUs. Compared to the HW2.5, running the exact software stack and sensors, Tesla reported a 21x improvement in frames per second.
| FSD Computer | FSD Chip |
|---|---|
| 72 W | 2x 36 W |
Die[edit]
SoC[edit]
- Samsung 14 nm process
- 12 metal layers
- 260 mm² die size
- ~20 mm x 13 mm die size
- 6,000,000,000 transistors
- 250,000,000 gates
.png)
CPU[edit]
- 3 x quad-core Cortex-A72 clusters
- 12 Cortex-A72 cores
- 2.2 GHz
- ~40.2 mm² die size for entire block
- ~12.8 mm² / quad-core cluster
- ~1.19 mm² / core
- ~12.8 mm² / quad-core cluster
.png)
_(annotated).png)
NPU[edit]
- 96 x 96 multiply-accumulates
- 9,216 MACs
- 36.864 trillion OPs
- 9,216 MACs @ 2 GHz
- ~47.54 mm²
.png)
Top bumps[edit]
- Samsung 14 nm process
- 12 metal layers
- 12,464 C4 bumps
Additional images[edit]
Additional images taken by WikiChip.
See also[edit]
- Nvidia Tegra Xavier
- Intel Mobileye EyeQ
Bibliography[edit]
- Tesla, personal communication, April 25, 2019
- Tesla Autonomy Day, April 22, 2019
- Tesla, IEEE Hot Chips 31 Symposium (HCS) 2019.
| base frequency | 2,200 MHz (2.2 GHz, 2,200,000 kHz) + |
| core count | 12 + |
| core name | Cortex-A72 + |
| core stepping | B0 + |
| designer | Tesla (car company) + |
| die area | 260 mm² (0.403 in², 2.6 cm², 260,000,000 µm²) + |
| die length | 20 mm (2 cm, 0.787 in, 20,000 µm) + |
| die width | 13 mm (1.3 cm, 0.512 in, 13,000 µm) + |
| first announced | April 22, 2019 + |
| first launched | March 10, 2019 + |
| full page name | tesla (car company)/fsd chip + |
| has ecc memory support | true + |
| instance of | microprocessor + |
| isa | ARMv8.0-A + |
| isa family | ARM + |
| ldate | March 10, 2019 + |
| main image | .png) + |
| manufacturer | Samsung + |
| market segment | Automotive + |
| max memory | 8,192 MiB (8,388,608 KiB, 8,589,934,592 B, 8 GiB, 0.00781 TiB) + |
| max memory bandwidth | 63.58 GiB/s (65,105.92 MiB/s, 68.269 GB/s, 68,268.505 MB/s, 0.0621 TiB/s, 0.0683 TB/s) + |
| microarchitecture | Cortex-A72 + |
| name | FSD Chip + |
| package | FCBGA-2116 + |
| process | 14 nm (0.014 μm, 1.4e-5 mm) + |
| supported memory type | LPDDR4-4266 + |
| tdp | 36 W (36,000 mW, 0.0483 hp, 0.036 kW) + |
| technology | CMOS + |
| thread count | 12 + |
| transistor count | 6,000,000,000 + |
| word size | 64 bit (8 octets, 16 nibbles) + |
.png){kind=link}