If you have already had negative experiences with collaborative work, feel free to share it in order to avoid repeating the same scenario.
Look for collaborations within your community. You are less likely to be tokenized or instrumentalized by the members of the same community.
Do you feel pressured or obliged to do something you do not want to do? If this is not articulated, you might be manipulated. To avoid this, paraphrase what your potential partner has stated, and inform the other person that you understand their position.