ParkMinseon1
KwonMin-Woo2*
-
(Department of Electric Engineering, Gangneung-Wonju National Uni- versity, Gangneung,
25457, Korea)
-
(Department of Electronic Engineering, Seoul National University of Science and Technology,
Seoul 01811, Korea)
Copyright © The Institute of Electronics and Information Engineers(IEIE)
Index Terms
Neuron, hardware-based Spike neural network, neuron circuit, excitatory, inhibitory, positive feedback field effect transistor
I. INTRODUCTION
The human brain is an exceptional hardware system capable of processing and storing
information rapidly with minimal power consumption [1,2]. This remarkable capability is achieved through the brain's structure, which consists
of over 100 billion neurons connected in parallel via synapses that transmit signals
[3,4,5]. Within this biological system, biological neurons play a crucial role in enabling
the brain to process information accurately and efficiently [6,7]. Neurons help to prevent excessive brain activation through excitatory and inhibitory
functions, which are essential for balancing long-term and short-term memory and information
storage [8,9]. Consequently, neuromorphic computing, which is considered a promising alternative
to overcome the high power consumption and performance limitations of conventional
von Neumann architectures, aims to emulate biological neural systems in hardware [10].
In hardware-based Spiking Neural Networks (SNN), a prominent artificial neural network
that mimics the brain's neural network, neuron circuits are designed to serve as the
basic computational units [11,12,13,14]. Conventional analog neuron circuits are composed of CMOS circuits and emulate the
integrate-and-fire mechanism of biological neurons [15,16,17]. However, conventional CMOS-based analog neuron circuits reveal certain challenges
in terms of power-performance-area (PPA) [18]. Firstly, there is high power consumption associated with the first inverter connected
to the membrane capacitor, which integrates the signals. This occurs during the switching
action of the inverter at the time of neuron circuit firing, leading to short-circuit
current and consequently high energy consumption [19]. Secondly, analog CMOS neuron circuit fail to effectively integrate both excitatory
and inhibitory functions and requiring large capacitors and numerous transistors to
ensure stable signal integration. This imposes limitations on the area in terms of
integration density.
To address these issues, we propose a neuron circuit that integrates excitatory and
inhibitory functions by combining feedback field effect transistor (FBFET) with CMOS
inverter. In the proposed neuron circuit, two membrane capacitors, which receive excitatory
and inhibitory signals, are connected to the gates of a dual-gate FBFET. By utilizing
the threshold voltage modulation characteristic of FBFET, we confirmed that the neuron
circuit could adjust its threshold according to the received inhibitory signal, thereby
suppressing neuron circuit activation. Thus, by utilizing a single FBFET device, we
successfully integrated both excitatory and inhibitory actions and the compact circuit
design enables us to overcome challenges related to area and integration density.
Furthermore, through the steep switching characteristic of FBFET, we also addressed
the PPA issues of conventional analog neuron circuits [20]. The neuron circuit we propose is based on the Winner Takes All mechanism, which
is used in Spiking Neural Networks (SNN) for efficient artificial neural networks
and accurate pattern recognition. The FBFET was fabricated and analyzed using Silvaco
TCAD simulation. Additionally, the neuron circuit operation was modeled and validated
through SPICE mixed-mode simulations.
II. FBFET SIMULATION RESULTS
1. FBFET Fabrication by Athena Simulation
We fabricated the FBFET using Silvaco's Athena Simulation. Figure 1 shows the fabrication process of the dual-gate FBFET. First, the FBFET is fabricated
on a silicon-on-insulator (SOI) wafer. A 5nm gate oxide layer is formed on the P-type
doped silicon through dry oxidation at 900?C for 2 minutes. Afterward, N-type doped
polycrystal silicon is deposited for gate photo and patterning, and then followed
by channel N-type doping to create a potential well in the energy band as illustrated
in Fig. 1(a). Next, 10nm oxide is deposited, followed by dry etch process to form the sidewall
spacer as shown in Fig. 1(b). The sidewall spacer not only separates the gate and control gate but also aids in
alignment during the control gate patterning process. Following this, the oxide for
the control gate is deposited using chemical vapor deposition (CVD). Lastly, we performed
the control gate patterning over the potential well formed by the N-type channel as
shown in Fig. 1(c). Afterward, with source and drain implantation along with the metal contacts, FBFET
fabrication was completed. Table 1 provides a detailed device parameter of the fabricated FBFET by Athena Simulation.
These values have been selected as the figures for the FBFET that provide the best
performance in the proposed neuron circuit.
Fig. 1. FBFET fabrication schematics. (a) Gate patterning and N- channel doping. (b)
Sidewall spacer formed. (c) Deposit oxide by CVD and control gate patterning.}
Table 1. Details of FBFET Device parameters and value
Parameters
|
Value
|
Total gate length
|
400 nm
|
Gate oxide thickness
|
5 nm
|
Body thickness
|
80 nm
|
Source doping concentration
|
${10}^{20}$ cm$^{-3}$
|
$P^-\ $ body doping concentration
|
${10}^{16}$ cm$^{-3}$
|
$N^-\ $ body doping concentration
|
${10}^{17}$ cm$^{-3}$
|
Drain doping concentration
|
${10}^{18}$ cm$^{-3}$
|
2. FBFET Characteristics and Simulation Results
We analyzed the FBFET using Silvaco Atlas simulation. The FBFET features a dual-gate
and PNPN doping structure ss shown in Fig. 2. This PNPN body doping creates an energy band as depicted in Fig 3. The most notable
characteristic is the potential well formed in the body under the control gate and
the potential barrier that well forms with the drain region. When a positive voltage
is applied to the gate, electrons overcome the barrier on the source side and accumulate
in the potential well. The accumulated electrons make the depth of the potential well
shallow and reduce the height of the potential barrier along with the applied drain
bias, allowing the electrons to move to the drain area [21]. This triggers a positive feedback mechanism, rapidly generating current flow and
causing the device to turn on with steep switching characteristics.
Fig. 2. Dual gated FBFET device structure.}
Fig. 3. Energy band diagram of the FBFET.}
In addition to structural features and mechanisms, the FBFET has other important characteristics.
Firstly, the control gate of the FBFET allows for the adjustment of the potential
well depth. As shown in Fig. 4(a), the depth of the potential well increases proportionally with the control gate voltage.
A deeper potential well increases the height of the potential barrier formed with
the drain region, thereby delaying the turn on time for the FBFET as illustrated in
Fig. 4(b). In other words, the FBFET can control threshold voltage by adjusting the voltage
applied to the control gate. This characteristic plays the most important role in
our study, as it indicates that the turn-on time of the device can be adjusted flexibly.
Fig. 4. Simulation result by control gate voltages adjustment (a) the deeper potential
well is formed (b) delaying FBFET turned on.}
Secondly, the FBFET's on/off characteristics depends on various drain voltage. Fig. 5 shows the simulation results of the drain voltage sweep from 1.5 V to 0.6 V. During
this process, the gate and control gate voltages were both maintained at 1 V. As the
drain voltage increases, a stronger electric field causes more carrier movement, which
rapidly reduces the height of the potential barrier with electron accumulation in
the potential well, thereby triggering a faster feedback process. This results in
a higher drain current. Furthermore, the device turns on through the feedback loop
at drain voltages up to 0.8 V. But at lower drain voltages, the potential barrier
is not sufficiently reduced, making it impossible to turn on.
Fig. 5. Simulation result of FBFET on/off characteristics and drain current various
by drain voltage.}
III. WINNER TAKES ALL
1. Spiking Neural Networks and Winner Takes All
SNNs are neural networks that aim to mimic the neural activity of neurons and synapses
in the biological brain. However, in the biological nervous system, neurons respond
competitively to input stimuli, with only the neurons receiving the strongest stimuli
becoming activated, while the others are repeatedly inhibited. This mechanism helps
the brain to efficiently allocate resources while quickly processing important information.
Similarly, research in SNNs has focused on incorporating such mechanisms, known as
Winner Takes All (WTA). The WTA mechanism ensures that only the most important neurons
are activated through competitive inhibition during the input processing stage, thereby
improving the network's efficiency and enabling more effective information processing
[21,22,23,24,25,26].
2. Mechanism of Winner Takes All
The WTA mechanism operates based on the following principles. When a specific input
signal pattern is presented, each neuron increases its membrane potential in response
to the excitatory input. This phase is referred to as the input signal accumulation
stage for initial activation. As all neurons elevate their membrane potential due
to the excitatory signals, the neuron that first reaches the threshold fires and generates
a spike. At this point, the activated neuron sends inhibitory signals to other neurons.
These inhibitory signals serve to prevent firing by increasing the threshold or decreasing
the membrane potential of other neurons within the same layer. This phase is called
the competitive inhibition stage or lateral inhibition [25,26]. As a result, only a small number of specific neurons win and are selectively activated,
while the others are inhibited. And only the activated neurons transmit stimulus signals
to the next layer. This process is well illustrated in Fig. 6.
Fig. 6. A simple schematic of an SNN artificial neural network illustrating the WTA
mechanism. Only the activated neurons send inhibitory signals to other neurons within
the same layer and transmit stimulus signals to the next layer.
The WTA mechanism is characterized by its high biological similarity and energy efficiency.
It reflects the structural constraints of the brain's nervous system, where neuronal
resources are limited and not all neurons can be activated simultaneously. Additionally,
by selectively activating only the winning neurons through competitive processes,
energy is conserved overall. Similarly, the biological brain minimizes energy consumption
through this method. The neuron circuit proposed in this study accurately reflects
the WTA mechanism. Using the characteristics of FBFET, the FBFET increases the threshold
of the neuron circuit and inhibits firing in proportion to the magnitude of the inhibitory
signals received from the activated neurons.
IV. INTEGRATION NEURONAL FUNCTIONS USING FBFET
Fig. 7 shows the schematic of the proposed neuron circuit that integration neuronal functions
using single device FBFET. The FBFET replaces the NMOS in the CMOS inverter. The gate
of the FBFET is connected to a membrane capacitor1 ($C_{mem1}$) that accumulates
excitatory signals, and the control gate is connected to a membrane capacitor2 ($C_{mem2}$)
that accumulates inhibitory signals to suppress neuron firing. In the proposed neuron
circuit, the dual gates of the FBFET integrate the excitatory and inhibitory signals
accumulated in the capacitors.
Fig. 7. Schematic of the proposed neuron circuit. The FBFET replaces the role of the
NMOS transistor in the first CMOS inverter.
1. Overall Operation of the Neuron Circuit
Before the neuron is activated, node1 is charged by Vdd1 and receives inhibitory signals
through inhibitory synapses from other neurons in the same layer, which are first
activated. $C_{mem2}$ charges in response to these inhibitory signals, raising the
potential of the membrane2 node. When the neuron receives excitatory signals from
the neurons of previous layer, $C_{mem1}$ accumulates the signals, and raising the
potential of membrane1. As the excitatory signals continue to accumulate and the potential
of membrane1 rises above the threshold voltage of the FBFET, the FBFET turns on, and
generating a spike. This indicates that the neuron has fired and is activated. When
the FBFET turns on, high-speed switching occurs by steep switching characteristics
of FBFET. This causing the voltage of Node1 to drop rapidly. The voltage of Node1
drops sharply to the minimum drain voltage of 0.8V necessary to maintain FBFET activation
and then fully drops to 0V through NMOS1. Additionally, the Fig. 8(a) shows a sharp increase in the concentration of electrons and holes. At that moment,
the FBFET turns on and which drops back to zero when Node1 drops sharply to the minimum
drain voltage of 0.8V necessary to maintain FBFET activation. Lastly, an output is
generated through inverter2, and the switch NMOS, which acts as a switch transistor
for the excitatory and inhibitory stages, is activated. The activated switch NMOS
discharges the capacitors in each stage, lowering the membrane potential to 0. Through
the reset operation, Node1's voltage also returns to 1, and preparing for the integration
of the next signal.
Fig. 8. Simulation results of neuron circuit's overall operation. (a) Neuron circuit
firing occurs when membrane1 potential exceeds the threshold voltage of the FBFET.
(b) Electrons and holes increase rapidly when FBFET turns on.
2. Integration of Excitatory and Inhibitory Functions
We propose a neuron circuit that integrates the excitatory and inhibitory functions,
which are essential operations of biological neurons, by using a single FBFET to receive
both excitatory and inhibitory input signals at the synapse. The operation of the
neuron circuit employs the Winner Takes All (WTA) mechanism. Specifically, we implemented
a process where the threshold of the neuron circuit is raised by receiving inhibitory
signals from the neuron that fires first.
When the neuron circuit receives an inhibitory signal through the inhibitory synapse,
it accumulates this signal in the inhibitory membrane capacitor ($C_{mem2}$). The
potential of membrane2 increases according to the magnitude of the inhibitory signal
received by $C_{mem2}$. Since $C_{mem2}$ is directly connected to the control gate
of the FBFET through membrane2, the voltage applied to the control gate increases.
As a result, the potential well of the FBFET becomes deeper, leading to a higher threshold
voltage for the FBFET.
Fig. 9. Simulation results of neuronal functions by increasing inhibitory membrane
potential. (a) Neuron circuit's firing is delayed. (b) Output's inhibition.
The high threshold voltage of the FBFET increases the threshold of membrane1 required
for neuron circuit firing. This necessitates a higher potential and more accumulation
of excitatory signals in $C_{mem1}$. Fig. 9(a) shows the Simulation results that as the potential in the inhibitory membrane increases,
the firing of the neuron circuit is delayed. We found that for every 0.1V increase
in the potential of the inhibitory membrane due to the inhibitory signal, the neuron's
firing is delayed by 0.07 $\mu$s as shown in Table 2. Additionally, the suppression of neuron firing also leads to a delay in the switching
operation of the inverter circuit and the generation of the final output as shown
in Fig. 9(b).
In summary, by directly connecting $C_{mem2}$, which accumulates the inhibitory signals
received from the neuron that fires first, to the control gate of the FBFET, we set
the threshold voltage of FBFET and suppress neuron circuit's firing based on the WTA
mechanism. This demonstrates that the integration of neuronal excitatory and inhibitory
functions was efficiently implemented using a single FBFET.
Table 2. Value of neuron circuit's firing time by increasing inhibitory membrane potential
V. CONCLUSION
In this study, we propose a neuron circuit that integrates excitatory and inhibitory
functions of neurons using FBFET. The proposed neuron circuit was designed by combined
FBFET into a CMOS inverter, utilizing the FBFET's excellent Subthreshold Swing characteristics
to achieve steep switching behavior and reduce short circuit current. This approach
addresses the performance and power consumption issues of conventional CMOS neuron
circuits. Additionally, by utilizing the dual-gate feature of the FBFET, we connected
a capacitor that accumulates excitatory signals to the gate and another capacitor
that receives inhibitory signals to the control gate. The more inhibitory signals
received, the higher the potential of the inhibitory membrane, which increased the
threshold voltage of the FBFET through the control gate's threshold adjustment. As
a result, the firing threshold of the neuron circuit was raised, and simulation results
showed that for every 0.1V increase in the inhibitory membrane's potential, neuron
activation was delayed by 0.07 $\mu$s. Consequently, we successfully addressed the
PPA issues of conventional neuron circuits and integrated the excitatory and inhibitory
functions of biological neurons using a single FBFET device.
ACKNOWLEDGMENTS
This study was financially supported by Seoul National University of Science &
Technology.
References
Strukov, Dmitri, et al., ``Building brain-inspired computing,'' Nature Communications,
vol. 10, pp. 4838-2019, 2019.

M. Tsodyks and C. Gilbert. ``Neural networks andperceptual learning,'' Nature, vol.
431, no. 7010, pp. 775-781, 2004.

C. Mead, ``Neuromorphic electronic systems,'' Proceedings of the IEEE, vol. 78, no.
10, pp. 1629–1636, 1990.

H. Yu, et al., ``Evolution of bio‐inspired artificial synapses: Materials, structures,
and mechanisms,'' Small, vol. 17, no. 9, 2000041, 2021.

V. M. Ho,, J.-A. Lee, and K. C. Martin. ``The cell biology of synaptic plasticity,''
Science, vol. 334, no. 6056, pp. 623-628, 2011.

H.-J. Park and K. Friston. ``Structural and functional brain networks: From connections
to cognition,'' Science, vol. 342, no. 6158, 1238411, 2013.

I. B. Levitan and L. K. Kaczmarek, The Neuron: Cell and Molecular Biology, Oxford
University Press, USA, 2015.

M. di Filippo, et al. ``Short-term and long-term plasticity at corticostriatal synapses:
implications for learning and memory,'' Behavioural Brain Research, vol. 199, no.
1, pp. 108-118, 2009.

H. R. Monday, T. J. Younts, and P. E. Castillo. ``Long-term plasticity of neurotransmitter
release: Emerging mechanisms and contributions to brain function and disease,'' Annual
Review of Neuroscience, vol. 41, no. 1, pp. 299-322, 2018.

J.-Q. Yang, et al., ``Neuromorphic engineering: From biological to spike‐based hardware
nervous systems,'' Advanced Materials, vol. 32, no. 52, 2003610, 2020.

S. B. Furber, F. Galluppi, S. Temple, and L. A. Plana, ``The SpiNNaker project,''
Proceedings of the IEEE, vol. 102, no. 5, pp. 652–665, May 2014.

I. Sourikopoulos, et al., ``A 4-FJ/Spike artificial neuron in 65 nm CMOS technology,''
Frontiers in Neuroscience, vol. 11, 123, 2017.

W. Maass, ``Networks of spiking neurons: the third generation of neural network models,''
Neural Networks, vol. 10, no. 9, pp. 1659-1671, 1997.

H. S. Seung, ``Learning in spiking neural networks by reinforcement of stochastic
synaptic transmission,'' Neuron, vol. 40, no. 6, pp. 1063-1073, 2003.

D. Kwon, S. Y. Woo, and J .H. Lee, ``Review of analog neuron devices for hardware-based
spiking neural networks,'' Journal of Semiconductor Technology and Science, vol. 22,
no. 2, pp. 115-131, 2022.

J. H. B. Wijekoon and P. Dudek. ``A CMOS circuit implementation of a spiking neuron
with bursting and adaptation on a biological timescale,'' Proc. of IEEE Biomedical
Circuits and Systems Conference, IEEE, 2009.

H. Tanaka, T. Morie, and K. Aihara. ``An analog CMOS circuit for spiking neuron models,''
International Congress Series, Elsevier, vol. 1291, 2006.

B. Joo, J.-W. Han, and B.-S. Kong, ``Energy-and area-efficient CMOS synapse and neuron
for spiking neural networks with STDP learning,'' IEEE Transactions on Circuits and
Systems I: Regular Papers, vol. 69, no. 9, pp. 3632-3642, 2022.

C.-S. Poon and K. Zhou. ``Neuromorphic silicon neurons and large-scale neural networks:
challenges and opportunities,'' Frontiers in Neuroscience, vol. 5, 108, 2011.

M.-W. Kwon, et al., ``Integrate-and-fire neuron circuit using positive feedback field
effect transistor for low power operation,'' Journal of Applied Physics, vol. 124,
no. 15, 2018.

J. Lee, M. Cha, and M,-W, Kwon. ``Capacitor-less low-power neuron circuit with multi-gate
feedback field effect transistor,'' Applied Sciences, vol. 13, no. 4, 2628, 2023.

N. Lynch, C. Musco, and M. Parter, ``Winner-take-all computation in spiking neural
networks,'' arXiv preprint arXiv:1904.12591, 2019.

Y. Fang, M. A. Cohen, and T. G. Kincaid. ``Dynamics of a winner-take-all neural network,''
Neural Networks, vol. 9, no. 7, pp. 1141-1154, 1996.

T. Fukai and S. Tanaka. ``A simple neural network exhibiting selective activation
of neuronal ensembles: from winner-take-all to winners-share-all,'' Neural Computation,
vol. 9, no. 1, pp. 77-97, 1997.

Z.-H. Mao and S. G. Massaquoi. ``Dynamics of winner-take-all competition in recurrent
neural networks with lateral inhibition,'' IEEE Transactions on Neural Networks, vol.
18, no. 1, pp. 55-69, 2007.

P. U. Diehl and M, Cook. ``Unsupervised learning of digit recognition using spike-timing-dependent
plasticity,'' Frontiers in Computational Neuroscience, vol. 9, 99, 2015.

Minseon Park is currently pursuing a bachelor's degree in the Department of Electronic
and Semiconductor Engineering at Gangneung-Wonju National University (GWNU). His main
research interests include the Neuron circuit using steep switching device, and In-memory
computing based on NAND Flash technology utilizing FBFETs.
Min-Woo Kwon received his B.S. and Ph.D. degrees in electrical and computer engineering
from Seoul National University (SNU), in 2012 and 2019, respectively. From 2019 to
2021, he worked at Samsung Semiconductor Laboratories, where he contributed to the
development of 1x nm DRAM cell transistors and their characterization. Since 2024,
he has been conducting research in the Department of Electronic Engineering at Seoul
National University of Science and Technology, where he is currently a professor.