Inspiration for Neural Networks, and there after deep learning largely comes from human attempt to mimic the functioning of human brain.
In loose sense, perceptron is an attempt to mimic functioning of neuron in the human brain.
There are some input numbers/features ( signals ), and a weighted sum of these numbers ( signals importance , stronger synapse ), finally a step function to activate or deactivate the output side ( trigger signal to other connecting neuron ).