I will give a brief overview of the research we are conducting on using robot swarms to study adaptive collective systems in the physical world. I will focus on (1) robot swarm to study physical interactions between individuals, and on (2) designing learning algorithms distributed over a robot swarm as a model for exploring social learning dynamics in a collective. I will also show some results on the evolution of cooperative behaviours and social learning obtained with this method.