Prepare all your ingredients by gathering ground beef, spices, and bread. Measure out garlic powder, onion powder, salt, and pepper. Slice Swiss cheese and rye bread.
In a small mixing bowl, combine mayonnaise, ketchup, Dijon mustard, Worcestershire sauce, and garlic powder. Stir until smooth and adjust seasoning with salt and pepper.
In a large skillet, heat olive oil over medium-high heat. Form ground beef into four equal patties. Cook patties for 4-5 minutes on each side, adding Swiss cheese on top in the last minute.
Melt butter in another skillet over medium heat. Place two slices of rye bread in the skillet, add a cheesy patty on each, and spread secret sauce on the remaining two slices of bread. Assemble the sandwiches.
Grill the sandwiches for 3-4 minutes on each side until the bread is golden brown and crispy. Remove from skillet, let cool for a minute, then cut in half and serve hot.