How far walking from the beach, and is it a beach you can swim in?
Ogunquit beach was about a 10 minute walk and you can absolutely swim in it.
The beach is about 4-6 minutes walk depending on how fast you walk. Swimming in it is possible, but the problem is the water is cold, so unless its super warm out for awhile, you might not find it warm enough, maybe in July/August, but definitely not in May.
Get an answer from The Blue Shutters Inn staff and past guests.