Optimisations

This commit is contained in:
Andras Schmelczer 2026-02-01 21:00:59 +00:00
parent 66c2a25457
commit 9179acd4cd
21 changed files with 653 additions and 139 deletions

View file

@ -4,6 +4,7 @@
```sh
curl -1sLf 'https://dl.cloudsmith.io/public/task/task/setup.deb.sh' | sudo -E bash
apt install task
task prepare
```
@ -34,30 +35,14 @@ task prepare
5. fibre optic availability
6. between london and bournemouth ish
7. [Y] historical prices
8. current listings
## Action plan
1. use openstreetmap api to get the map
## Data Sources
- [Price Paid](https://www.gov.uk/government/statistical-data-sets/price-paid-data-downloads)
- [English Indices of Deprevation 2025](https://www.gov.uk/government/statistics/english-indices-of-deprivation-2025)
- The English Indices of Deprivation (IoD25) measure relative levels of deprivation in 33,755 small areas or neighbourhoods, called Lower-layer Super Output Areas (LSOAs), in England.
- [Population by Ethnicity and Region 2021](https://www.ethnicity-facts-figures.service.gov.uk/uk-population-by-ethnicity/national-and-regional-populations/regional-ethnic-diversity/latest/#download-the-data)
- [Crime](https://data.police.uk/data/)
- [Postcode -> GPS](https://www.arcgis.com/sharing/rest/content/items/077631e063eb4e1ab43575d01381ec33/data)
Nice to haves?
- <https://www.gov.uk/government/statistics/english-indices-of-deprivation-2025> - file 8!
## Backend Data Sources
@ -70,10 +55,54 @@ Nice to haves?
- [Open Geography](https://geoportal.statistics.gov.uk/)
- [CommunitiesOpenData](https://communitiesopendata-communities.hub.arcgis.com/)
- [PlanetOSM](https://planet.openstreetmap.org/) for open street map POI
- [TFL api](https://api-portal.tfl.gov.uk/signin)
- [EPC](https://epc.opendatacommunities.org/login) - <https://epc.opendatacommunities.org/downloads/domestic>
- [naptan](https://naptan.dft.gov.uk/naptan/schema/2.4/doc/NaPTANSchemaGuide-2.4-v0.57.pdf)
rightmove:
curl '<https://www.rightmove.co.uk/api/property-search/listing/search?searchLocation=E14&useLocationIdentifier=true&locationIdentifier=OUTCODE%5E749&buy=For+sale&radius=20.0&_includeSSTC=on&index=0&sortType=2&channel=BUY&transactionType=BUY>'
curl '<https://www.onthemarket.com/async/search/properties-v2/?search-type=for-sale&location-id=e13&view=map-list>'
Make it mobile friendly
Serve the frontend from the server
Add an account management page
categories the categories
mkdir -p data/crime
unzip data/d29f0314840ef7dcbb5cde66e383fe08059dab5a.zip -d data/crime/
rm data/d29f0314840ef7dcbb5cde66e383fe08059dab5a.zip
https://xploria.co.uk/data-sources/
panning is slow
epc oopt out https://www.gov.uk/guidance/energy-performance-certificates-opt-out-of-public-disclosure
righmove lins
Use the approach you described. Look at the current state of the frontend and backend and add user management to it. By default, anonymous users can use the map but only in central london. if they try zooming out, the server refuses to provide data and the users will be
prompted to buy a lifetime license to continue (or zoom back in). Just before buying a license, they have to register by providing their email address and password, then they need to complete the stripe check out workflow. There must be a use page showing the lifetime
license key. Implement the full pocketbase/server/frontend integration. For admins, give an option to generate an invite link, opening which prompts you to register and gives you a free license forever. Have a cool animation with party poppers on the successful acquiring
of a license. For non-admin users, allow inviting friends for 30% off the price. Also add a support page that shows my email address, and add a FAQ on the same page too. Add a docker compose file to host pocketbase and the rust server. While doing this, protect the
server against DOS-ing. Once you're logged in, you can save your searches and then look at your saved searches. Instead of just a share button in the header, add a save search one for logged in users and a login button (on all pages) for not-logged in users. Don't
support profile pictures or full names to avoid GDPR requirements.
embedd google street view
how to handle too many pois