Not using Facebook to log into services does not exclude you from this. Almost all mobile games I've used (and only those) are listed on my FB activity despite not giving them my login or even having the Facebook or Messenger apps installed.
I think this may be by correlating the Android advertising ID?
I think this may be by correlating the Android advertising ID?