@Harsh: Yes you can convert by selecting all the images and then right click -> select Convert into webp then hit apply, you will see then all the images converted into webp.

If anything still confusing for you then let me know. Thanks.