Voting power is determined by Staked FRAK Balance. When a user Stakes FRAK it is recorded in a subgraph and used to determine voting power via snapshot. The amount of Staked FRAK is determined at the block in which the vote starts.
For example, if you have 10,000 FRAK Staked and the voting period begins at block 14133913, you have 10,000 votes for this proposal. If you remove before a proposal begins voting, you will not have voting power. If you remove during a proposal, you will still have the voting power; however, will not be able to vote on future proposals unless you restake FRAK.