From WikiChip
Difference between revisions of "bitmain/sophon/bm1680"
< bitmain‎ | sophon

 
(8 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
{{bitmain title|Sophon BM1680}}
 
{{bitmain title|Sophon BM1680}}
−
{{mpu
+
{{chip
 
|name=Sophon BM1680
 
|name=Sophon BM1680
 
|image=bitmain sophon bm1680.png
 
|image=bitmain sophon bm1680.png
Line 12: Line 12:
 
|process=28 nm
 
|process=28 nm
 
|technology=CMOS
 
|technology=CMOS
 +
|max memory=16 GiB
 
|v core=0.9 V
 
|v core=0.9 V
 
|v core tolerance=5%
 
|v core tolerance=5%
Line 22: Line 23:
 
|package module 1={{packages/bitmain/fcbga-1599}}
 
|package module 1={{packages/bitmain/fcbga-1599}}
 
}}
 
}}
−
'''Sophon BM1680''' is a [[neural processor]] designed by [[Bitmain]] and introduced in 2017. The BM1680 is capable of performing both network inference and network training.
+
'''Sophon BM1680''' is a [[neural processor]] designed by [[Bitmain]] and introduced in 2017. The BM1680 is capable of performing both network inference and network training. Capable of delivering up to [[peak flops (single-precision)::2 TFLOPS]] (SP), the BM1680 has a typical power dissipation of 25 W with a peak power of 41 W. The chip was [[taped-out]] in April 2017 and began sampling in June.
  
 
Manufactured on [[TSMC]]'s [[28 nm|28HPC+]] process, the BM1680 is capable of 80 billion algorithmic operations per second. Bitmain claims the chip is designed not only for inference, but also for training of neural networks, suitable for working with the common [[artificial neural network|ANNs]] such as [[convolutional neural network|CNN]], [[recurrent neural network|RNN]], and [[deep neural network|DNN]].
 
Manufactured on [[TSMC]]'s [[28 nm|28HPC+]] process, the BM1680 is capable of 80 billion algorithmic operations per second. Bitmain claims the chip is designed not only for inference, but also for training of neural networks, suitable for working with the common [[artificial neural network|ANNs]] such as [[convolutional neural network|CNN]], [[recurrent neural network|RNN]], and [[deep neural network|DNN]].
  
 
== Overview ==
 
== Overview ==
−
The chip consists of five subsystems: [[NPU]], [[MCU]], Chip Link, Memory, and Peripherals. The MCU Subsystem is a low-power embedded [[ARM]] microcontroller. The NPU Subsystem consists of 64 [[NPUs]], the hub, and an NPU Schedule Engine. The scheduling engine is in charge of controlling the data flow to the individual NPUs. Bitmain has not many intimate details of the NPU cores but each core is known to have 512 KiB of program-visible [[SRAM]] and supports 64 single-precision operations. With a total of 64 NPUs, the chip has a total of 32 [[MiB]] of [[cache]] and a peak performance of 2 [[TFLOPS]] (single-precision).  
+
The chip consists of five subsystems: [[NPU]], [[MCU]], Chip Link, Memory, and Peripherals.  
 +
 
 +
The MCU Subsystem is a low-power {{arch|32}} embedded [[ARM]] microcontroller which can be boot from SPI Flash (ITCM interface). The microcontroller has an 8 KiB of [[L1I$]] and 8 KiB of [[L1D$]]. Additionally, there is also a VPFv2 coprocessor for floating point operations support.
 +
 
 +
The NPU Subsystem consists of 64 [[neural processor|NPUs]], the hub, and an NPU Schedule Engine. The scheduling engine is in charge of controlling the data flow to the individual NPUs. Bitmain has not many intimate details of the NPU cores but each core is known to have 512 KiB of program-visible [[SRAM]] and supports 64 single-precision operations. With a total of 64 NPUs, the chip has a total of 32 [[MiB]] of [[cache]] and a peak performance of 2 [[TFLOPS]] (single-precision).  
  
 
:[[File:BM1680 block diagram.png|650px]]
 
:[[File:BM1680 block diagram.png|650px]]
 +
 +
 +
===  BMDNN Chiplink ===
 +
The chip incorporates Bitmain's proprietary fabric called ''BMDNN Chiplink technology''. The [[fabric]] is a flexible, low latency link that communicates over a high-speed [[SerDes]] PHY. Two ports are available on each chip which allows multiple BM1680s to be daisy chained together to form a larger network.
 +
 +
In a typical configuration (i.e., a PCIe [[accelerator]] [[accelerator card|card]]), two BM1680s chips are wired together using chiplink. The first node in the chain is then connected to a host control (e.g., a custom [[ASIC]] unit or simply an [[FPGA]]) which provides a PCIe interface to the host processor (e.g., on a typical server a {{intel|Xeon}}). Data from the host processor is then sent to the host controller on the accelerator unit which is then distributed across all the [[NPU]]s on all the available nodes.
 +
 +
::[[File:BM1680 chiplink topology.png|450px]]
 +
 +
Current offering by [[Bitmain]] is limited to two BM1680s chips per [[accelerator card]], however in theory the chip can be chained to form a much larger network. The primary limitations of the network are power consumption and thermal dissipation as well as PCIe bandwidth which Bitmain requires to be x4 lanes per node (or 3.9 GB/s, 8 GT/s). For example, current offerings by Bitmain features two nodes on a PCIe Gen3 x8 card.
 +
 +
Below is a schematic of Bitmain's SC+ PCIe Gen 3 accelerator card.
 +
 +
 +
::[[File:BM1680 SC+ card schematic.png|800px]]
 +
 +
== Memory controller ==
 +
{{memory controller
 +
|type=DDR4-2666
 +
|ecc=Yes
 +
|max mem=16 GiB
 +
|controllers=1
 +
|channels=4
 +
|max bandwidth=79.47 GiB/s
 +
|bandwidth schan=19.87 GiB/s
 +
|bandwidth dchan=39.74 GiB/s
 +
|bandwidth qchan=79.47 GiB/s
 +
}}
 +
 +
== Expansions ==
 +
* SPI Flash Controller
 +
* UART
 +
* Two-wire I2C

Latest revision as of 08:59, 11 August 2018

Edit Values
Sophon BM1680
bitmain sophon bm1680.png
General Info
DesignerBitmain
ManufacturerTSMC
Model NumberBM1680
MarketArtificial Intelligence
IntroductionOctober 25, 2017 (announced)
November 8, 2017 (launched)
General Specs
FamilySophon
Microarchitecture
Process28 nm
TechnologyCMOS
Max Memory16 GiB
Electrical
Vcore0.9 V ± 5%
VI/O1.8 V ± 5%
TDP41 W
TDP (Typical)25 W
OP Temperature0 °C – 125 °C
Packaging
PackageFCBGA-1599 (FCBGA)
Dimension33 mm x 33 mm x 3.18 mm
Pitch0.8 mm
Balls1599
Sophon BM1680 is a neural processor designed by Bitmain and introduced in 2017. The BM1680 is capable of performing both network inference and network training. Capable of delivering up to 2 TFLOPS
2,000,000,000,000 FLOPS
2,000,000,000 KFLOPS
2,000,000 MFLOPS
2,000 GFLOPS
0.002 PFLOPS
(SP), the BM1680 has a typical power dissipation of 25 W with a peak power of 41 W. The chip was taped-out in April 2017 and began sampling in June.

Manufactured on TSMC's 28HPC+ process, the BM1680 is capable of 80 billion algorithmic operations per second. Bitmain claims the chip is designed not only for inference, but also for training of neural networks, suitable for working with the common ANNs such as CNN, RNN, and DNN.

Overview[edit]

The chip consists of five subsystems: NPU, MCU, Chip Link, Memory, and Peripherals.

The MCU Subsystem is a low-power 32-bit embedded ARM microcontroller which can be boot from SPI Flash (ITCM interface). The microcontroller has an 8 KiB of L1I$ and 8 KiB of L1D$. Additionally, there is also a VPFv2 coprocessor for floating point operations support.

The NPU Subsystem consists of 64 NPUs, the hub, and an NPU Schedule Engine. The scheduling engine is in charge of controlling the data flow to the individual NPUs. Bitmain has not many intimate details of the NPU cores but each core is known to have 512 KiB of program-visible SRAM and supports 64 single-precision operations. With a total of 64 NPUs, the chip has a total of 32 MiB of cache and a peak performance of 2 TFLOPS (single-precision).

BM1680 block diagram.png


BMDNN Chiplink[edit]

The chip incorporates Bitmain's proprietary fabric called BMDNN Chiplink technology. The fabric is a flexible, low latency link that communicates over a high-speed SerDes PHY. Two ports are available on each chip which allows multiple BM1680s to be daisy chained together to form a larger network.

In a typical configuration (i.e., a PCIe accelerator card), two BM1680s chips are wired together using chiplink. The first node in the chain is then connected to a host control (e.g., a custom ASIC unit or simply an FPGA) which provides a PCIe interface to the host processor (e.g., on a typical server a Xeon). Data from the host processor is then sent to the host controller on the accelerator unit which is then distributed across all the NPUs on all the available nodes.

BM1680 chiplink topology.png

Current offering by Bitmain is limited to two BM1680s chips per accelerator card, however in theory the chip can be chained to form a much larger network. The primary limitations of the network are power consumption and thermal dissipation as well as PCIe bandwidth which Bitmain requires to be x4 lanes per node (or 3.9 GB/s, 8 GT/s). For example, current offerings by Bitmain features two nodes on a PCIe Gen3 x8 card.

Below is a schematic of Bitmain's SC+ PCIe Gen 3 accelerator card.


BM1680 SC+ card schematic.png

Memory controller[edit]

[Edit/Modify Memory Info]

ram icons.svg
Integrated Memory Controller
Max TypeDDR4-2666
Supports ECCYes
Max Mem16 GiB
Controllers1
Channels4
Max Bandwidth79.47 GiB/s
81,377.28 MiB/s
85.33 GB/s
85,330.263 MB/s
0.0776 TiB/s
0.0853 TB/s
Bandwidth
Single 19.87 GiB/s
Double 39.74 GiB/s
Quad 79.47 GiB/s

Expansions[edit]

  • SPI Flash Controller
  • UART
  • Two-wire I2C
Retrieved from "https://en.wikichip.org/w/index.php?title=bitmain/sophon/bm1680&oldid=81385"
Facts about "Sophon BM1680 - Bitmain"
RDF feed
Has subobject
"Has subobject" is a predefined property representing a container construct and is provided by Semantic MediaWiki.
Sophon BM1680 - Bitmain#package +
core voltage0.9 V (9 dV, 90 cV, 900 mV) +
core voltage tolerance5% +
designerBitmain +
familySophon +
first announcedOctober 25, 2017 +
first launchedNovember 8, 2017 +
full page namebitmain/sophon/bm1680 +
has ecc memory supporttrue +
instance ofmicroprocessor +
io voltage1.8 V (18 dV, 180 cV, 1,800 mV) +
io voltage tolerance5% +
ldateNovember 8, 2017 +
main imageFile:bitmain sophon bm1680.png +
manufacturerTSMC +
market segmentArtificial Intelligence +
max memory16,384 MiB (16,777,216 KiB, 17,179,869,184 B, 16 GiB, 0.0156 TiB) +
max memory bandwidth79.47 GiB/s (81,377.28 MiB/s, 85.33 GB/s, 85,330.263 MB/s, 0.0776 TiB/s, 0.0853 TB/s) +
max memory channels4 +
max operating temperature125 °C +
min operating temperature0 °C +
model numberBM1680 +
nameSophon BM1680 +
packageFCBGA-1599 +
peak flops (single-precision)2,000,000,000,000 FLOPS (2,000,000,000 KFLOPS, 2,000,000 MFLOPS, 2,000 GFLOPS, 2 TFLOPS, 0.002 PFLOPS, 2.0e-6 EFLOPS, 2.0e-9 ZFLOPS) +
process28 nm (0.028 μm, 2.8e-5 mm) +
supported memory typeDDR4-2666 +
tdp41 W (41,000 mW, 0.055 hp, 0.041 kW) +
tdp (typical)25 W (25,000 mW, 0.0335 hp, 0.025 kW) +
technologyCMOS +