San Remo is the gateway to Phillip Island on the eastern entrance of Western Port. It dates back to 1840 when the deep-water port at Griffith's Point was used to export local products such as wattlebark, farm produce and cattle. In the 1870s coal, transported by a tramway from Kilcunda further along the coast, was shipped to Melbourne.

The township that grew up around the port became a popular tourist spot and in 1888 was renamed San Remo, after the town on the Italian Riviera. Before the suspension bridge was built in 1940 visitors had to rely on ferries for access to Phillip Island between San Remo and Newhaven. The bridge had a limit of only six tons and tourist buses had to unload before crossing. A new concrete bridge was opened in 1969 at a cost of $3,250,000.

Commercial fishing in San Remo began around 1909 when rail links with Melbourne enabled quick transport to city markets. Today San Remo is one of Victoria's significant ocean and bay fishing ports, and the San Remo Fisherman's Co-operative is the leading supplier of fresh fish for the region. Holiday makers can enjoy ocean fishing charters, cruises and maritime tours, located at the jetty.

Today San Remo is a fully operational fishing village with the San Remo Fisherman’s Co-op being the major fresh fish supplier in the area. San Remo is well serviced, with motels, bed & breakfasts, caravan park, restaurants, a shopping centre, medical clinic and community care centre. Children's Beach is a sheltered family beach while Foots Beach has an excellent beach. Barbeques, playgrounds and toilets are located on Marine Parade and Back Beach Road. The San Remo Recreation Hall, tennis courts , squash courts, Bowling Club are all located in Wynne Ave.

Several nature walks allow you to enjoy the scenery and points of historical interest. A 15 minute easterly walk from the Lions Park along Back Beach Road leads to Foots, an excellent surf nursery. The George Bass Coastal Walk begins at the southern end of Punchbowl Road and is a scenic six-kilometre walk to Kilcunda (one way). Another suggestion is a foreshore ramble along Bore Beach where the historic coal bore can be seen, and then on to Shelly Beach, Griffith Point and Quarry Rocks where stone was quarried around 1870 to build banks and business chambers in Melbourne. A short walking track on the foreshore provides good views of black swans and passing fishing boats.

Pelicans are fed daily at 11.30 am. These majestic birds with their waddle and funny eating antics delight many visitors. Pelican feeding is located on the foreshore adjacent tot the fishing Co-Op.