Repo size work

[stucka]

Need to document safer way to shrink the repo size

Need to remove the Notebook that does it in a breaking way

Maybe need to shrink some of the other branches

Close out #5

Verify this is fixing #4

[stucka]

Documentation start -- DO NOT USE THIS ---

Find initial commit
https://stackoverflow.com/questions/18407526/git-how-to-find-first-commit-of-specific-branch
git cherry master -v | head -n 1

Reset https://whitep4nth3r.com/blog/rewrite-git-history/

git checkout il
git cherry main -v | head -n 1
21c0a1d
git reset --soft 21c0a1d
git add -A data/
git commit -m "Reset IL"
git push -u -f origin il

git checkout wa
git cherry main -v | head -n 1
a89842e
git reset --soft a89842e
git add -A data/
git commit -m "Reset WA"
git push -u -f origin wa

git checkout transformer
git cherry main -v | head -n 1
5511a48
git reset --soft 5511a48
git add -A data/
git commit -m "Reset transformer"
git push -u -f origin transformer

[stucka]

Also maybe document how to find size of branches, e.g.:
git rev-list --disk-usage --objects HEAD..il

Branches must be checked out for that to work. Maybe that's safely scriptable, but the Shrodinger's Notebook thing is in play.

[stucka]

Show branch sizes, in bash:
git for-each-ref --format='%(refname)' |
while read branch
do
size=$(git rev-list --disk-usage --objects HEAD..$branch)
echo "$size $branch"
done |
sort -n

Results now ... why is there an origin/origin/wa? ...
0 refs/heads/main
0 refs/remotes/origin/HEAD
0 refs/remotes/origin/main
6963 refs/remotes/origin/ak
29528 refs/remotes/origin/ut
53318 refs/remotes/origin/sd
53580 refs/remotes/origin/hi
66334 refs/remotes/origin/al
134689 refs/remotes/origin/ct
291668 refs/remotes/origin/wi
348199 refs/remotes/origin/origin/wa
414156 refs/remotes/origin/mt
802293 refs/remotes/origin/id
1069308 refs/remotes/origin/ne
1523234 refs/remotes/origin/md
1540321 refs/remotes/origin/in
1811925 refs/remotes/origin/mi
2359496 refs/remotes/origin/tn
2804939 refs/remotes/origin/fl
3229237 refs/remotes/origin/ga
3673777 refs/remotes/origin/mo
4216396 refs/remotes/origin/tx
4833845 refs/remotes/origin/nj
5333310 refs/remotes/origin/or
6437243 refs/remotes/origin/la
6469633 refs/remotes/origin/sc
6500019 refs/remotes/origin/va
6663005 refs/remotes/origin/ny
7415177 refs/remotes/origin/ri
8531617 refs/remotes/origin/ia
8673717 refs/remotes/origin/de
17197681 refs/remotes/origin/oh
18038832 refs/remotes/origin/dc
18203431 refs/remotes/origin/vt
27108603 refs/remotes/origin/co
31563529 refs/remotes/origin/ca
33104387 refs/remotes/origin/ok
43845782 refs/remotes/origin/nm
51030901 refs/remotes/origin/ks
65325721 refs/remotes/origin/ky
70276832 refs/remotes/origin/az
96548777 refs/remotes/origin/me
333931979 refs/remotes/origin/wa
435718337 refs/remotes/origin/il
582069999 refs/remotes/origin/transformer

[stucka]

Tentative instructions:

Basic approach:
Make a new directory, call it, whatever, git-rebuild.
Change into it.
Download the entire full repo.
Make a backup copy of the entire full repo.
Make another backup copy.
Identify what state branches (plus "transformer") you want to try to shrink.
Copy your "master" Pipfile and Pipfile.lock into the root of your new master directory, the git-rebuild

Verify this thing isn't going to run while you're moving so much stuff around.

For each statename:
Make a complete copy of the entire full repo.
Rename it to your statename.
cd statename
git checkout statename
git cherry main -v | head -n 1
21c0a1dsomethingsomething
git reset --soft 21c0a1dsomethingsomething
Windows: copy ..\Pip* .
Unix: cp ../Pip* .
git add -A data/
git commit -m "Reset statename"
git push -u -f origin statename
cd ..

[stucka]

Adding Pipfiles ... causes more problems.

[stucka]

Possible workaround for states that had Pipfiles at that first commit ... trying with Kentucky. Tries to better isolate the commit to only the data directory, with a temporary .gitignore that should allow the Pipfile changes to come through. Maybe?

Tentative instructions:

Basic approach:
Make a new directory, call it, whatever, git-rebuild.
Change into it.
Download the entire full repo.
Make a backup copy of the entire full repo.
Make another backup copy.
Identify what state branches (plus "transformer") you want to try to shrink.
Copy your "master" Pipfile and Pipfile.lock into the root of your new master directory, the git-rebuild

Verify this thing isn't going to run while you're moving so much stuff around.

For each statename:
Make a complete copy of the entire full repo.
Rename it to your statename.
cd statename
git checkout statename
git cherry main -v | head -n 1
21c0a1dsomethingsomething
git reset --soft 21c0a1dsomethingsomething
echo "Pipfile" >>.gitignore
echo "Pipfile.lock" >>.gitignore
git add data
git commit -m "Reset statename"
git push -u -f origin statename
cd ..

[stucka]

From the bash script, a priority list:
10069940 refs/remotes/origin/dc
11665894 refs/remotes/origin/or
14615782 refs/remotes/origin/ia
17506212 refs/remotes/origin/oh
20106754 refs/remotes/origin/co
20844537 refs/remotes/origin/nm
21755075 refs/remotes/origin/ks
23428511 refs/remotes/origin/ca
36667542 refs/remotes/origin/me
41480665 refs/remotes/origin/az
405273507 refs/remotes/origin/wa
430615420 refs/remotes/origin/il
619520039 refs/remotes/origin/transformer

[stucka]

March 2026 update:
The bash script doesn't work until you get the -n flag off the sort on this computer.

Priority list:

347910928 | refs/remotes/origin/transformer
-- | --
304199165 | refs/remotes/origin/wa
168246917 | refs/remotes/origin/il
39657647 | refs/remotes/origin/co
19605673 | refs/remotes/origin/ca
18556720 | refs/remotes/origin/az
18338010 | refs/remotes/origin/ia
17728671 | refs/remotes/origin/oh
15683198 | refs/remotes/origin/or
14453774 | refs/remotes/origin/dc
13608055 | refs/remotes/origin/nm
11164945 | refs/remotes/origin/me
10910071 | refs/remotes/origin/vt
10359115 | refs/remotes/origin/de
10159186 | refs/remotes/origin/ks
10148162 | refs/remotes/origin/nj
9980674 | refs/remotes/origin/ri
9610998 | refs/remotes/origin/la
9456416 | refs/remotes/origin/sc
9074376 | refs/remotes/origin/tx
8624864 | refs/remotes/origin/ny
8469945 | refs/remotes/origin/va
8373703 | refs/remotes/origin/ga
6239412 | refs/remotes/origin/mo
6213121 | refs/remotes/origin/fl
5263919 | refs/remotes/origin/ok
4371439 | refs/remotes/origin/tn
2885629 | refs/remotes/origin/id
2727242 | refs/remotes/origin/md
2278821 | refs/remotes/origin/in
2182168 | refs/remotes/origin/ne
2095839 | refs/remotes/origin/mi
2040843 | refs/remotes/origin/ky
938281 | refs/remotes/origin/mt
563123 | refs/remotes/origin/wi
349556 | refs/remotes/origin/origin/wa
305852 | refs/remotes/origin/ct
214465 | refs/remotes/origin/pa
185402 | refs/remotes/origin/hi
109766 | refs/remotes/origin/al
86905 | refs/remotes/origin/sd
45008 | refs/remotes/origin/ut
9562 | refs/remotes/origin/ak

[stucka]

I lost so much time from the quote marks in an earlier version. This forces a push to wipe out any screwy commits before we wipe out most commits anyway. Also removes some extras, e.g., push -u -f origin statename just needs to be push -f.

For each statename:
Make a complete copy of the entire full repo.
Rename it to your statename.
cd statename
git checkout statename
git push -f
git cherry main -v | head -n 1
21c0a1dsomethingsomething
git reset --soft 21c0a1dsomethingsomething
echo Pipfile >>.gitignore
echo Pipfile.lock >>.gitignore
git add data
git commit -m "Reset statename"
git push -f
cd ..

[stucka]

^^^ did not work on oh or transformer branches. Did a straight git push -f off a backup on each of those.