You guys forget the Temple compound at Katas.. Which also happened to have a very central role in Hindu rligion… Apparently it was where the pandya brothers stayed during their adventure, and its also where part of the Mahabarath is thought to have taken place..
This place was also mentioned by Hun Sangh in his travels around 600 bc I believe, although im not sure if the site was Hindu at the time of Buddhist..