Moritz Helias and colleagues show in PLoS Computational Biology that also in local networks of binary neurons the correlation structure results from the recurrent dynamics. NEST technology for the simulation of binary neurons is used to explore the validity of results obtained in the limit of infinite network size for the biological range of network sizes.