Near the blue Geo Symbol is a raised panel that is not affected by any Geo Panels. Destroying the Geo Symbol from here will leave you unaffected by the Geo chain.
Magnificent Gate
Near the base panel are two geo symbols. One of them increases the enemy's strength and one increases the amount of experience you gain from defeating the enemies. Before destroying the Enemy Boost geo symbol, you should check the bonuses being offered for having a high combo count. If the bonuses include alot of experience or good items, you may want to put the experience geo symbol on the Geo Panels before destroying the Enemy Boost symbol to create a large chain. Alternatively, destroy the Enemy Boost symbol and then place the Experience symbol on the colored tiles to increase the experience gained from defeating the enemies.
Once the Enemy Boost symbol is out of the way, you should have no problem defeating the foes.