New City Market would be the closest grocery option.
If you would consider baked goods, perhaps Fire Island Bakeshop on K St or The Kobuk on 5th can be an option although they close at 4/5. If you're open to try, there is pelmeni, a russian dumpling place across captain cook that closes to midnight,