Yale University Silliman College Quadrangle Architectural View. Silliman is the largest Residential College on the Yale University Campus occupying a full city block facing College Street to the West and Grove Street to the North. Van Shef Tower stands above the West Portico to Silliman.