Ah thank you for your site! Before your post, I didn't know the government auctioned off homes online and through following the links to the auctions I learned about the FHA $100 down payment program.
yeah but do you really want to live in an area that has HUD housing? Most of the time they aren't in the best areas and/or in high crime areas. also perhaps the house is gunna take 5-6 figures of work to rehab and become livable. far better ways to burn your $ unless you just really need a house ASAP to live in for a year.
That may be true in general but I’ve found through years of bargain hunting various items that there are always options that aren’t bad. It takes more work to find them, and you might have to wait a while until the right one comes. It’s worth pursuing.
I am still on Vercel (yes I know, trying to migrate off...) and it gives you automated alerts when there are anomalous traffic spikes. Funnily enough, I have had about 10 scrapers from various places scraping the site in the last week.
I'm curious how much of this stuff is actually civil asset forfeiture? (Not to blame the site(s) for such practices, but to think about the whole ecosystem of how a government comes to have a bicycle, switch, truck etc)
I have a friend who handles dispositions of equipment for a very large government contractor. You'd probably be very surprised to see some of what goes through his warehouse. He got rid of two kid's go-karts last year. Government contractors buy some weird stuff for weird reasons.
Or want to get absolutely ripped off by the non-government sellers that are somehow allowed on those platforms. The whole point of Govdeals et al is that the seller is a known-ish quantity. If I wanted to roll the dice on garbage with fresh paint I'd be on Ritchie bros.
Govdeals managed services (or whatever they call it now) is just as questionable as 3rd party sellers on any given big bog store's ecommerce "platform".
Bid price is kind of irrelevant for milspec. What's actually important is understanding what the spec requires. A crappy rucksack from Amazon doesn't have a milspec, they can say whatever they want as long as it lasts longer than the 30 day warranty and return period. Obviously govsurp rucksacks don't have warranties but there's a legit spec you can look up that says how it was made and tested. Since it wouldn't have been purchased without a certificate of conformity, you can be sure that when the rucksack was new, it should have had a certain level of quality. No milspec manufacturer is designing the product far beyond the milspec because that increases cost and they won't sell. If Ford makes a car that will go for 500k miles without major repairs, it would likely wouldn't sell very well because of how expensive it would be. Meanwhile a car that can go to like 150k miles without major repairs will sell better because it costs less and is still a reasonable lifetime.
The lowest bider thing is such a lame meme. Vendors are going to design a product to cost as little as possible to meet spec. Most consumer products have little to no required specs so they can make it even cheaper. However, since milspec products often just have one spec they are designed to, you have a limited selection of quality. No one is making milspec birkin bags. But in the consumer space, you can buy anything between Temu and high-end designer quality.
Really needs a way to refine search results to "within X miles of $someGeoPointOrZipCode". I am seeing a lot of neat stuff in California ... but i'm not going to drive 7 hours to go pick it up :)
I almost bought a lighthouse 25 years ago off of a GSA auction. I'm glad my bid lost because I didn't read the fine print carefully about how much the upkeep would cost.
Cool idea, I tapped the vehicles / heavy equipment tabs expecting to be taken to listings. Nothing happened. Maybe these should all take you to a page that lets you sign up to see listings?
First thing I searched was Pokemon cards and found items with bids at 50% higher than market value...either shill bidding or folks who are bidding blindly.
I work in the HR space and though about something similar with jobs. A bunch of recuiters will publish the same job. What I figured would be best is have one job entry and show all the recruiters who published and let you go to one of them.
US government auctions are scattered across at least 28 platforms. GSA sells decommissioned federal fleet. DLA Disposition moves military gear. The US Marshals front seized property through bid4assets. PublicSurplus runs school district and state-agency lots. GovDeals fronts thousands of county and municipal agencies. Fannie Mae and HUD auction foreclosed homes. None of these sites index together, and most have search UX that lost a fight with 2008.
So I scraped them all and put one search box in front. 180,276 active listings as of today, normalized into a shared schema in Postgres with full-text search. About 53,000 new listings come in every week.
A few real things you can buy this week, all live in the data:
The work that took longest wasn't the scraping (each source has its own quirky JSON or HTML), it was the dedup. The same Fannie Mae foreclosure shows up under three different addresses across three platforms. A "2008 Ford F-150" from GSA Fleet looks structurally identical to one from PublicSurplus, but they're different vehicles with different VINs, and the only way to know is to fingerprint enough metadata to make a
confident match.
There's a deal score per listing (price vs category median, bid velocity, time remaining, starting-bid ratio) and SEO landing pages per state-by-category combo, mostly because long-tail government-auction queries on Google are nearly all unanswered.
Stack: Next.js, Postgres, TypeScript scrapers per source, daily refresh.
Happy to answer questions about scraping the federal sites (some of them really do not want to be scraped) or how the deal scoring works.
I hope you're adding some fictitious entries (https://en.wikipedia.org/wiki/Fictitious_entry) to track where those scrapes might be going.
https://reason.com/category/criminal-justice/civil-asset-for...
The worst ones will try to add a few extra holes the night before the auction
Govdeals managed services (or whatever they call it now) is just as questionable as 3rd party sellers on any given big bog store's ecommerce "platform".
I didn't realize the government could become Amazon.
Mil-spec transport containers? Excellent.
Mil-spec rucksacks? Not so excellent.
The lowest bider thing is such a lame meme. Vendors are going to design a product to cost as little as possible to meet spec. Most consumer products have little to no required specs so they can make it even cheaper. However, since milspec products often just have one spec they are designed to, you have a limited selection of quality. No one is making milspec birkin bags. But in the consumer space, you can buy anything between Temu and high-end designer quality.
Really needs a way to refine search results to "within X miles of $someGeoPointOrZipCode". I am seeing a lot of neat stuff in California ... but i'm not going to drive 7 hours to go pick it up :)
i saw a listing that ends in 39 minutes and was at $806
i click to be taken to the listing and its $1,270.00
https://youtube.com/@project.lighthouse
Great idea though
The server is under heavy load. Please try again in a moment. "
> Error: Invalid frameId for foreground frameId: 0
on Chrome 147.0.7727.102
Sometimes requiring months in advance
So I want an agent that does that automatically and I don’t want to do it on my computer
So I scraped them all and put one search box in front. 180,276 active listings as of today, normalized into a shared schema in Postgres with full-text search. About 53,000 new listings come in every week.
A few real things you can buy this week, all live in the data:
- A 2000 Bell 430 helicopter (executive model), $250k starting, 0 bids: https://www.govdeals.com/asset/8103/23762
- A 1985 Cessna 182R aircraft in Missouri, $33k starting, 0 bids: https://www.govdeals.com/asset/36476/430
- An M75 APC armored personnel carrier on Ritchie Bros, no bids yet: https://www.rbauction.com/pdp/armored-tank-m75-apc-personnel...
- A Rolls-Royce ship thruster, never used, $500k starting: https://www.govdeals.com/asset/247/16144
- A 2.3 kg iridium-platinum ingot (police seizure on PropertyRoom), 52 bids, currently $175k: https://www.propertyroom.com/l/iridium-platinum-ingot-ir90-p...
- A 1927 Seagrave fire truck, "runs, drives, and titled," $24k, 0 bids: https://www.govdeals.com/asset/285/16223
- A truck-mounted forklift from a manufacturer literally named "Donkey & Burro": https://www.govplanet.com/for-sale/Forklifts/14842632
The work that took longest wasn't the scraping (each source has its own quirky JSON or HTML), it was the dedup. The same Fannie Mae foreclosure shows up under three different addresses across three platforms. A "2008 Ford F-150" from GSA Fleet looks structurally identical to one from PublicSurplus, but they're different vehicles with different VINs, and the only way to know is to fingerprint enough metadata to make a confident match.
There's a deal score per listing (price vs category median, bid velocity, time remaining, starting-bid ratio) and SEO landing pages per state-by-category combo, mostly because long-tail government-auction queries on Google are nearly all unanswered.
Stack: Next.js, Postgres, TypeScript scrapers per source, daily refresh.
Happy to answer questions about scraping the federal sites (some of them really do not want to be scraped) or how the deal scoring works.
https://www.govdeals.com/en/asset/2402/13188
I wish I had jumped on those offers back when they were in the back of Boys Life, Popular Mechanics, and SOF magazines back in the day.