Two boards that are not just easy and hard
The 4x4 grid is eight pairs and the 6x6 is eighteen, which is more than double rather than a small step up. It is not simply that the bigger board takes longer - it crosses the point where you can no longer hold the whole layout in your head, and that changes how you play rather than how hard you have to concentrate.
On the small board most people can genuinely remember every card they have turned over, so a good game is close to perfect. On the large one you cannot, so you end up building partial knowledge - a rough sense of which quarter of the board a particular icon lives in - and accepting that some flips are informed guesses. The second of those is the more interesting game.
Worth knowing before you pick: four players on the 4x4 board splits eight pairs between them and is over almost immediately. If you are playing in a group, 6x6 is the one to choose.