To cancel integrated 1:1s, you must delete the event in your Google Calendar. If both parties just responded 'No' to the invitation, the 1:1 will stay as it is in Lattice.
Learn more in What happens if I delete a synced 1:1 event from my Google or Outlook calendar?