1) James was probably not Jsus' brother (since we don't even have proof that Jsus lived). The term was often used to speak of the people who were in the same cult -- aka the Jerusalem brotherhood.

2) the Jerusalem church ddin't worship Jsus (as I'm sure you know).
And everything that Sarah tells you, listen to her voice. Genesis, 21:12