Jefferson's appearance was a lot less fancy and more casual than the other presidents before him. It was straying from the tradition of fancy clothes and even carrying a sword.
The Inauguration took place at our new capital city, Washington D.C. Unlike other presidents whose where held else where because of the relocation of the capital.
Jefferson also contained the size of the military. They posed as a threat to the independence of the republic and it was also identified with Washington and Hamilton. Jefferson wanted to make his own identifications because he was the president and wanted people to understand he made the choices now.
All of these things contrast to the first 2 presidents and are things Jefferson has done that is different from the others before him.
Jefferson also wanted to dismantle the government. This was to pay off debt and end taxation with a need for a national bank, thus stopping those unhealthy relationships.
Eliminating tariffs or taxed goods shipped into the country was another thing Jefferson did. This was so more people bought U.S. products because they where cheaper.