Unless you specifically close them then all Android apps you open remain open in the background

 

To close an app (or all apps) click the recent apps icon at the bottom of the screen

 

 

You will then see a screen showing all currently open apps

 

From here you can click the X next to individual apps to close them, or you can click the clean up icon at bottom to close all open apps