The Power of Large Language Vision Models for Classification and Sales (CarMax)

I recently had the pleasure of an initial interview with Zach at CarMax. During our discussion about potential projects, I realized that the new GPT-4 vision model I've been developing could significantly contribute to CarMax's operations. Specifically, it can classify vehicles and create compelling calls to action on its website, encouraging customers to visit the dealership.

My experience with large language models includes working with the latest GPT-4 Vision module for a personal project. Recognizing its potential, I adapted this model for a CarMax-specific use case.

For a practical test, I used an image of a car I recently purchased, curious about the model's response to an image containing two vehicles. The performance exceeded expectations. With a straightforward prompt, the model accurately focused on the target vehicle, identifying its make, model, and the year of production.

Here is my prompt setup:

The prompt I chose in this case was simple: You are an expert in car evaluation guess the make, and model of the vehicle in the image.

The GPT-4 Vision's response was insightful: (highlighted in blue see below for full text.)

The full response from the API:

"The vehicle in the image is a GMC Yukon XL. This can be discerned by its distinctive body style, size, and design cues such as the grille, headlights, and the badge visible on the rear quarter panel. The "XL" designation indicates that this is the extended-length version of the GMC Yukon, offering additional cargo space behind the third-row seats. This model is particularly similar to the second generation of the Yukon XL, which was produced from around 2007 to 2014."

Impressively, the vehicle is indeed a 2007 Yukon Denali XL. The model not only identified the vehicle accurately but also provided intriguing details about it. I further challenged the model to persuasively encourage a visit to the CarMax dealership for a test drive, and the response was equally impressive.

New Prompt: You are an expert salesmen with the goal of getting a user on the carmax website to come in and test drive this vehicle. Be sure to check the image and talk about the features of the car and reasons to buy. Here is some information you gathered previously: (I passed the previous response back into the model.)

The full response: Fantastic choice! The GMC Yukon XL in the image is a perfect blend of style, space, and functionality. As you can see, it comes in a sleek white color that exudes class and keeps the vehicle looking cool even on the hottest days. The Yukon XL's extended-length body means more room for cargo, making it ideal for road trips, moving large items, or simply having the flexibility to transport anything you need.\n\nThe Yukon XL's spacious interior is perfect for families or anyone who values comfort and roominess during their drive. With its three rows of seating, you can accommodate up to eight passengers, ensuring that everyone has ample legroom and personal space. Plus, with the XL model, you get additional cargo space behind the third row, so you can fit luggage, sports equipment, or groceries without compromising passenger comfort.\n\nThis particular model, as part of the second generation of Yukon XLs, is known for its robust reliability. It comes with powerful V8 engine options that offer a smooth and confident driving experience, whether you're navigating city streets or cruising on the highway. And with its towing capacity, outdoor enthusiasts can easily hitch a trailer or boat for weekend getaways.\n\nAdditionally, you'll find that the Yukon XL is equipped with essential safety features, providing a sense of security whenever you're behind the wheel. The size and height of the vehicle not only give you a commanding view of the road but also ensure substantial protection in the event of an accident.\n\nRemember, the best way to truly appreciate the Yukon XL's features is to experience it yourself. That's why I'd like to invite you to come down and take it for a test drive. Feel the comfort of the seats, the responsiveness of the engine, and the ample view from the driver's seat. Plus, you'll have the opportunity to ask any questions you might have and explore the vehicle inside and out.\n\nContact us today to schedule your test drive, and let the GMC Yukon XL show you what it can do. Whether you're looking for a reliable family vehicle, or a powerful companion for your adventures, the Yukon XL could be the perfect match for you. Let's get you behind the wheel so you can experience the power and luxury firsthand!

This level of detailed interaction opens up exciting possibilities for enhancing the car-buying experience via a chatbot on the CarMax website. While the experimental chat GPT API currently offers features like assistants that can be customized with CarMax data, integrating the vision API into this system could be a future advancement.

Concerning the cost-effectiveness of this technology, I utilized 2273 tokens for the two prompts, which translates to a mere 2.273 cents. This underscores not only the affordability but also the efficiency of such advanced AI tools.

I am thrilled about the opportunity at CarMax and am confident in my ability to introduce innovative solutions to the car-buying process. If you have any questions or need further information, please don't hesitate to reach out. My academic background, including a top 2% score in Chemistry Nationally, a full-ride scholarship for Mathematics at CSU Pueblo, a perfect 4.0 GPA in my Master’s in Data Science, and a recommendation from the program director, underscores my commitment to excellence and innovation.

It is just my 2.273 cents.