Home Entrance Everyone Wiki Search Login Register

Welcome, Guest. Please login or register. - Thinking of joining the forum??
April 24, 2024 - @168.51 (what is this?)
Forum activity rating: Four Star Posts: 51/1k.beats Unread Topics | Unread Replies | Own Posts | Own Topics | Random Topic | Recent Posts
News: :happy: Open the all windows! Your mind needs storms and air! :happy:

+  MelonLand Forum
|-+  Forum Hub
| |-+  ⚛︎ ∙ MelonLand Projects
| | |-+  SAve MY nEOCiTy! - Neocities site downloader <3


« previous next »
Pages: [1] 2 Print
Author Topic: SAve MY nEOCiTy! - Neocities site downloader <3  (Read 1133 times)
Melooon
Hero Member ⚓︎
*****


So many stars!

SpaceHey: Friend Me!
StatusCafe: melon
iMood: Melonking
Itch.io: My Games

View Profile WWW

First 1000 Members!spring 2023!Squirtle!!!!MIDI WarriorMIDI Warrior1234 Posts!OzspeckCool Dude AwardRising Star of the Web AwardMessage BuddyPocket Icelogist!OG! Joined 2021!The Smallest Ozwomp Known To ManBug!
« on: November 18, 2023 @39.02 »


Hello! I'd like to share my neocities site archival tool! I noticed a lot of people have trouble downloading their sites so I put this lil app together!

It's really handy to be able to download your site in order to save multiple copies of it (particularly if you're planning a redesign); in order to make local edits if you're gonna be working offline, or if you'd like to move to a new web host!

It's available for Mac, Windows and Linux!

Features:
  • Downloads ALL site files, even unlinked ones!
  • Works even if the official Download button is missing from your profile!
  • Optional folder time-stamping for site archives!
  • Attempts to re-try unsuccessful downloads!
  • Provides real-time feedback!
  • Provides a results log including any files it fails to archive!

Screenshot of v0.0.1


Downloads & Links!

You can download on my site here  :grin:
https://melonking.net/melon?z=free/software/neocities-downloader

You can also look at the source code here  :ha:
https://github.com/Melonking906/SAve-MY-nEOCiTy
« Last Edit: November 18, 2023 @83.51 by Melooon » Logged


everything lost will be recovered, when you drift into the arms of the undiscovered
keybladekid6
Jr. Member ⚓︎
**


hey roxy! boys night! lol

iMood: keybladekid6

View Profile WWW

First 1000 Members!Joined 2023!
« Reply #1 on: November 18, 2023 @249.95 »

!!! thank you so much for making this!! i was actually planning on redownloading all of my site files manually recently and it would have taken forever, i'll try this out right away  :cheerR:

is there any particular pattern to the uppercase/lowercase letters? I tried spelling out a word with them but couldn't figure it out  :dive:

xoxo, lolo =3
Logged

"that day, beneath that ruby sky..."
Capybara
Casual Poster ⚓︎
*


Large rodent

StatusCafe: capybara

View Profile WWW

Joined 2023!
« Reply #2 on: November 18, 2023 @250.80 »

Thank you so much for this!!! I've been stressed out over wanting an offline copy of my site but most of my backups are outdated, my site is too big to download on Neocities itself, etc. but I'll use this tomorrow!
Logged

tarraxahum
Full Member ⚓︎
***


Xx_O_o_xX

SpaceHey: Friend Me!
StatusCafe: tarraxahum
iMood: tarraxahum
Matrix: Chat!

View Profile WWW

First 1000 Members!Joined 2022!
« Reply #3 on: November 18, 2023 @472.44 »

Just tried it out, works like a charm! Thank you so much Melon, now backuping will be SO much easier <3

Loved the soundtrack, by the way. Kinda made me feel in some old-school hacker movie  :cool:
Logged



"Why change the past, when you can own this day?" (c)
wygolvillage
Sr. Member ⚓︎
****


meow!!!

StatusCafe: wygolvillage
iMood: wygolvillage

View Profile WWW

First 1000 Members!Joined 2023!
« Reply #4 on: November 18, 2023 @612.03 »

This tool is perfect! I tried it out today since it was about time I make a backup. It's so easy to use :O
Logged


BlazingCobaltX
Full Member ⚓︎
***


StatusCafe: blazingcobaltx

View Profile WWW

First 1000 Members!Joined 2023!
« Reply #5 on: November 18, 2023 @665.68 »

Lifesaver! :chef: I literally went to bed last night thinking I have to backup my site, and this tool did it fast and properly.
Logged
j
Full Member ⚓︎
***


bleh bleh *gargle gargle*


View Profile WWW

First 1000 Members!Joined 2023!
« Reply #6 on: November 18, 2023 @706.17 »

this is really cool! i love the UI design :)
i've got to say: you always make programs way more artsy than i ever could - i'm a little jealous @Melooon!

you inspired me to make something similar too - as a little challenge for myself. i'm more of a minimalist terminal geek myself, so here's something you can run in a terminal if you prefer just bash!

Code
#!/bin/sh

read -p "USERNAME: " USERNAME
read -p "PASSWORD: " PASSWORD
read -p "SITE-NAME: " SITE_NAME
DATE=$(date '+%Y-%m-%d')

CREDS_OK=$(curl --output /dev/null --user "$USERNAME:$PASSWORD" \
--url "https://neocities.org/api/list" --silent -w "%{http_code}")

if [ ! "$CREDS_OK" == "200" ]
then
    echo "Problem: $CREDS_OK"
    exit
fi

SITE_OK=$(curl --output /dev/null --url "https://$SITE_NAME.neocities.org" \
--silent -w "%{http_code}")

if [ ! "$SITE_OK" == "200" ]
then
    echo "Problem: $SITE_OK"
    exit
fi

mkdir -p "./$SITE_NAME-$DATE"
curl --silent https://neocities.org/api/list \
--user "$USERNAME:$PASSWORD" \
| grep "path" | cut -d '"' -f4 | \
xargs -I {} curl --silent -o "$SITE_NAME-$DATE/{}" \
--location --url "https://$SITE_NAME.neocities.org/{}"

echo "Success"
Logged

i go by j, she/they :)
Melooon
Hero Member ⚓︎
*****


So many stars!

SpaceHey: Friend Me!
StatusCafe: melon
iMood: Melonking
Itch.io: My Games

View Profile WWW

First 1000 Members!spring 2023!Squirtle!!!!MIDI WarriorMIDI Warrior1234 Posts!OzspeckCool Dude AwardRising Star of the Web AwardMessage BuddyPocket Icelogist!OG! Joined 2021!The Smallest Ozwomp Known To ManBug!
« Reply #7 on: November 18, 2023 @731.71 »

so here's something you can run in a terminal if you prefer just bash!
Wow getting it down to 33 lines is incredible! Although the USERNAME and SITE_NAME are always the same (even when you have multiple sites), so you could go smaller :grin:

Id love to see more handy tools like this; the other cool lil bash script that could be done is one that returns the total site size based of the list! (people seem to enjoy knowing that info)

is there any particular pattern to the uppercase/lowercase letters?
I just did it like that to be kool I didn't consider anyone would go looking for deeper meaning  :drat:
« Last Edit: November 18, 2023 @735.06 by Melooon » Logged


everything lost will be recovered, when you drift into the arms of the undiscovered
j
Full Member ⚓︎
***


bleh bleh *gargle gargle*


View Profile WWW

First 1000 Members!Joined 2023!
« Reply #8 on: November 18, 2023 @944.99 »

Quote from: Melooon
Wow getting it down to 33 lines is incredible! Although the USERNAME and SITE_NAME are always the same (even when you have multiple sites), so you could go smaller :grin:

thanks! definitely don't look under the hood at the line counts of the tools i used (shell script, read (libc), curl etc...) :P

you're right about the username and site_name stuff, but i tend to use my email (instead of my username) to login to neocities - which would make fetching URLs a little difficult if i were to use the same variable:

Code
https://email@provider.neocities.org

... so unfortunately there's a need for both!

Quote from: Melooon
Id love to see more handy tools like this; the other cool lil bash script that could be done is one that returns the total site size based of the list! (people seem to enjoy knowing that info)

haha! don't tempt me! :P

that being said - the neocities API doesn't offer anything like this; you'd still have to download the entire site, then run `du` to get the size of the directory - i suppose it's a two birds, one stone scenario?
Logged

i go by j, she/they :)
Melooon
Hero Member ⚓︎
*****


So many stars!

SpaceHey: Friend Me!
StatusCafe: melon
iMood: Melonking
Itch.io: My Games

View Profile WWW

First 1000 Members!spring 2023!Squirtle!!!!MIDI WarriorMIDI Warrior1234 Posts!OzspeckCool Dude AwardRising Star of the Web AwardMessage BuddyPocket Icelogist!OG! Joined 2021!The Smallest Ozwomp Known To ManBug!
« Reply #9 on: November 18, 2023 @951.31 »

that being said - the neocities API doesn't offer anything like this
Actually, it does! When you do /api/list you get a list of all files, but each file also lists its size in bytes; you just have to iterate the list and add up all the sizes (I do this in my app to give download feedback) - so you can get the entire site size with a single API call, no download needed!
Logged


everything lost will be recovered, when you drift into the arms of the undiscovered
j
Full Member ⚓︎
***


bleh bleh *gargle gargle*


View Profile WWW

First 1000 Members!Joined 2023!
« Reply #10 on: November 18, 2023 @964.31 »

Actually, it does! When you do /api/list you get a list of all files, but each file also lists its size in bytes; you just have to iterate the list and add up all the sizes (I do this in my app to give download feedback) - so you can get the entire site size with a single API call, no download needed!

i didn't realize! i was looking for an individual endpoint specific to that purpose - but this makes more sense. might add it in which case; thanks!
Logged

i go by j, she/they :)
Corrupted Unicorn
Jr. Member ⚓︎
**



View Profile WWW

First 1000 Members!Joined 2023!
« Reply #11 on: November 21, 2023 @958.02 »

YEAH!! Gotta try this soon. I make a backup of my website manually but this WILL come in handy.
Logged

georgemoody
Jr. Member ⚓︎
**


To Tux or not to Tux, that is the question

SpaceHey: Friend Me!
StatusCafe: georgemoody
iMood: georgemoody
Matrix: Chat!
XMPP: Chat!

View Profile WWW

First 1000 Members!Joined 2023!
« Reply #12 on: November 24, 2023 @933.06 »

Thanks to this little tool I moved my website from neocities to envs.net! thank you Mel!  :4u:
Logged

I have no idea what I’m doing.
Corrupted Unicorn
Jr. Member ⚓︎
**



View Profile WWW

First 1000 Members!Joined 2023!
« Reply #13 on: January 06, 2024 @523.13 »

Hey, may I ask, what is the password requested for?

Not that I don't trust you dear Meloon, but my old-school Internet upbringing is rearing its head and bleating "NEVER EVER SHARE YOUR PASSWORD WITH ANYBODY!" so it would be good to know why is it being asked for and what it is done with it.
Logged

sig
Sr. Member ⚓︎
****


the great

iMood: sigmatic

View Profile WWW

First 1000 Members!Certified chocoboGoose!Joined 2022!
« Reply #14 on: January 06, 2024 @624.10 »

Hey, may I ask, what is the password requested for?

I assume it's to verify you're the owner of the site so that you can't just rip any old Neocities page?
Logged

          
The world ends with you. If you want to enjoy life, expand your world. You gotta push your horizons out as far as they go.
Pages: [1] 2 Print 
« previous next »
 

Vaguely similar topics! (3)

Best way to have a 2 column site?

Started by ObspogonBoard ☔︎ ∙ I need Help!

Replies: 3
Views: 1923
Last post February 13, 2023 @208.53
by fLaMEd
How do you prefer to keep your site organized (or not)

Started by NightdriftBoard ✁ ∙ Web Crafting

Replies: 26
Views: 5779
Last post January 26, 2024 @915.29
by Paprika
POLL: How many personal sites have you built?

Started by xandraBoard ✁ ∙ Web Crafting

Replies: 30
Views: 4354
Last post January 11, 2024 @150.49
by xXWebMasterXx_Gina

Melonking.Net © Always and ever was! SMF 2.0.19 | SMF © 2021, Simple Machines | Terms and Policies Forum Guide | Rules | RSS | WAP2


MelonLand Badges and Other Melon Sites!

MelonLand Project! Visit the MelonLand Forum! Support the Forum
Visit Melonking.Net! Visit the Gif Gallery! Pixel Sea TamaNOTchi