Take a picnic around the colonial naval housing. There are a lot of art festivals going on like Figment Fest (which sometimes lasts all summer) and Gov Ball if you want to check out music.
Jeff Lagasca recommends biking to Governors Island. I approve.
*one of many Governors Island mentions I’ll be writing