Chambers, who first joined the Reds on loan in November last year, extended his loan deal on the South Coast until the end of the season back in January.
However, having secured survival in League Two, the Gills have recalled the 19-year-old early from his loan to be involved in their squad for their last three games of the season.
The youngster made 30 appearances for the Reds in all competitions, netting on three occasions.
Everyone at the Club would like to wish Josh the best of luck for his future career and thank him for his contribution this season.