Press and hold the Back button, swipe through your open apps and choose the necessary one, then press the Close icon.
Windows Phone 8.1 offers a faster way to close an app: press and hold the Back button, then swipe down on the app.
See here for more details and the source of information.
Have more questions? Submit a request