I have torn down and rebuilt this bike more then once to powder coat them, so I have removed and re installed that part a few times. Its an easy job if you have the tools and something to hold the bike in the air while your doing it to take the bikes weight off the swingarm. As that part is basically what holds the swingarm onto the frame . You could probably still do it without suspending the bike, but it makes it a lot easier as there is no pressure on the mounts, so lining up the parts is easier with it suspended.
Id help you out for a few bucks but Scarborough is a little far to drive my V8 truck from Mississauga, it would cost me more then its worth in gas to get out to you. If you can bring the bike to me, Id do it for a few bucks