iPad Calendar View

I have been using calendar view using the Show All button to see all photos for the given year. I’m having an issue where I accidentally swipe - this makes it go to the next date with photos. Which makes sense when you’re looking at it in the day view. But it takes me away from the show all for the year, so I have to go back two levels and click on show all again to get back to where I was. If this swipe could navigate to the next year, or whatever matches the type of view I’m in, that would be great.