Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chia - rclone upload all plots at once (parallel upload problem) #337

Open
dzeto opened this issue Sep 25, 2022 · 4 comments
Open

Chia - rclone upload all plots at once (parallel upload problem) #337

dzeto opened this issue Sep 25, 2022 · 4 comments

Comments

@dzeto
Copy link

dzeto commented Sep 25, 2022

Can you please check why parallel uploads on Dropbox through Rclone doesn't work? It's uploading only 1 plot at once, but not all in parallel when they are finished. I tried different options but can't find what is causing a problem.

I use below configuration in manifest:

  • RCLONE=true
  • TOTAL_UPLOADS=8
  • ENDPOINT_LOCATION=dropbox
  • ENDPOINT_DIR="0"
  • JSON_RCLONE=....
@dzeto
Copy link
Author

dzeto commented Sep 25, 2022

Below rclone comand works on my local Linux servers, but don't know how to add that command on Akash cloud as workaround solution for Chia plotter. Any help would be really appriciated. Thank you!

EXAMPLE:
while true; do rclone move /tmp/plots/ --include "*.plot" /mnt/googledrive/ ; sleep 30; done & disown

@88plug
Copy link
Contributor

88plug commented Sep 26, 2022

Please see : https://docs.akash.network/deploy/chia-on-akash#rclone-to-google-drive
You need to put the contents of your rclone.conf into JSON_RCLONE= variable and escape each line with a \n

@dzeto
Copy link
Author

dzeto commented Sep 28, 2022

I did like below, but it's only uploading 1 plot per once. On plot management page i see only 1 log file for currently uploading plots. All new plots don't start auto-uploading in parallel, but all waits on each other to finish first. I use crypt option for dropbox so my final distination is: dropbox-crypt. Thank you for help.

        JSON_RCLONE=
        [dropbox]\n
        type = dropbox\n
        chunk_size = 149M\n
        token = {"access_token":"example","token_type":"bearer","refresh_token":"example","expiry":"example"}\n
        [dropbox-crypt]\n
        type = crypt\n 
        remote = dropbox:/backup/\n
        password = example\n
        password2 = example\n
        no_data_encryption = true

chiaaaaaaaaaaaaaaaaaaa

@88plug
Copy link
Contributor

88plug commented Dec 8, 2022

Can you please try again with the latest release : cryptoandcoffee/akash-chia:316

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants