You can find the Vibration feedback switch in Settings (gear icon in the menu). If enabled (it is enabled by default), your device will slightly vibrate during most popular actions to provide you additional feedback that your input was received. You can disable this at any time, though.

Remember that this setting does not sync (you can have two different states of this setting on each device) and the vibration will only work on devices that support it.