Sounds like you’re uncomfortable and want a graceful way to bow out without hurting/offending anyone. If you’re not comfortable, don’t go. Just be upfront that are not comfortable at that venue but would love to catch up at lunch next week and pick a restaurant that you like.