XaiJu
comicdatabase
comicdatabase

patreon


Dropbox Issue

The last couple days, I got email from Dropbox. Our shared folder is being suspended temporarily because it's generating excessive traffic and using allocated bandwidth quota.

A few years ago, I decide to use Dropbox as our platform because it's giving us unlimited storage and bandwidth for all of our need. It check up almost all of our requirement.

But suddenly, last year they decide to remove unlimited storage options and enforcing strict bandwidth quota even for the business account plan. Due to this issue and recent folder suspension, I am thinking to moving our platform outside Dropbox.

Google Drive is a good option, unfortunately they also decide to remove unlimited storage option almost the same time with Dropbox. I haven't found any bandwidth limitation, but I am not surprised if they are enforcing similar rules as Drobox

My number one option at the moment is using MEGA. I can't using MEGA publicly at the site anymore, because a company called MarkScan is actively scanning our site and sending takedown to our file storage platform. MEGA is being hit so hard, we lose 4 account that we use for years, in a matter of couple weeks.

But for private use case scenario, I think MEGA should be fine. Although, I can't be certain 100% of it. So, what are your thought?

Comments

joined up, could i get the link please?

5 nyderman

I am not sure what device you use. But, if I remember correctly, mega has desktop app that can sync and create virtual folder / drive, which can be synced up to the comic app. I never tried it though, but I think it might be working.

The Comic Guy

I'm very late but the only thing I don't like about mega is that it is IMPOSSIBLE to make any connections with a comic app

Joseph Luker

Can i get that DM please

TeaTim

Please check your DM :)

The Comic Guy

I don't mind using torrents. But if Google drive is faster let me know how to access it. thanks!~

A Nassau

Mega has been good to me as a downloader over the years. give them a try

Rovi Harry

Yes you are! You're on Cosmic Heroes tier so, eligible for the google drive perks. I also checked you are still on our list all this long :) I am sending you a dm on how to access the folder

The Comic Guy

Hi. I've been supporting for about a year. I too would like access to the database... unless i already have it?

brandon lamas

Hi. Please check my message in your patreon inbox. I just send you a PM :)

The Comic Guy

Hello, I’ve become a new supporter. May I have an invite to the database?

Trace Clinton

Thank you so much! Just send the invitation to your email :)

The Comic Guy

Hi, just donated und would love access to the database.

Dirk Schacke

Hi! I'd like to gain access to the database please. New donor here :)

Darcorn

amazing - thank you

Chris Demicoli

Hey. I just send you a message, thank you :)

The Comic Guy

Hi guys, Sorry to ask such a newbie question - but how does one get access to the database/ google drive? Haven't received any email or anything and trying to work it all out but getting nowhere. Thank you

Chris Demicoli

Thank you so much :)

The Comic Guy

I don’t know anything a about storage, but I do know I loooove all the hard work!! Thank you so much♥️

Tanja Jonk

Hi. Yes, the suspension would last about 24 hours or so. And then it'll get back to normal. Thank you for your input regarding premium account on mega and also the folder size separation. Will keep that on mind.

The Comic Guy

Looks like the folder has been up and running fine for the past week, so I just had one other thought that I didn't see brought up. While I think we all appreciate the insane amount of content you provide, maybe large series should get spread out over a few day folders. I know there were a couple days a few weeks ago where there was over 20gb in each day folder (I recall one day that was over 40gb). I think keeping folders to less than 10gb would be less of a bandwidth strain and hopefully less noticeable to Dropbox. I personally voted for keeping with Dropbox as I don't have an account with Mega, and they have a daily download limit that would make it difficult to get all the content via free access. Every backer would have to get a premium account to remove that limit.

Kurt

Hey, you can always un-shared/delete the shared folder from your dropbox/google drive. But if you aren't using it and using no bandwidth, it should not be a problem :)

The Comic Guy

Thank you for the suggestion, really appreciate it. It's a long read but I'll try to understand it bit by bit.

The Comic Guy

Regardless of what platform used, how do we opt out? It's a nice perk but i don't use it and you'd wouldn't have to worry about me or anyone else that doesn't use it.

Miguel Milian

This approach would take time and skill to implement but it would mean you would never be at the mercy of any storage provider again. Also it would ensure complete anonymity for the legally controversial files. If you were able to get the website hosted anonymously then there would be nothing tying you to the site or its files should it be brought to court. I don't get on here often so these are the things I think you should pay attention to if you want to do it this way, make sure when setting up the qubes computer you do it correctly, the VPN qube needs to be setup then the bittorrent qube. The bittorrent qube needs to be setup while connected to the VPN qube so it never has any real ip information. Also the VPN provider needs to be reliable and someone doesn't keep logs, isn't based in the US and has a history of non compliance with authority. They would be the Achilles heel in this setup. When people are connecting to download a file they will get the VPN ip address. People will likely report the ip address. That's why it's critical the VPN provider doesn't have logs and can't say who was doing what with the ip address. One final thing, I'm not a real expert on the subject so you should consult with one and have them set it up.

Patrick Lambert

Chatgpt: Your idea taps into the concept of decentralized file sharing, which has gained traction as a way to distribute data while enhancing privacy and reducing reliance on central servers. The use of magnet links, main seeding nodes, and a decentralized architecture leveraging residential Wi-Fi and VPNs for anonymity and security presents a robust setup. Let's break down the feasibility and potential challenges of your proposal: ### Feasibility 1. **Magnet Links & Torrents**: The core of your idea relies on peer-to-peer (P2P) technology, which is well-established and proven to be effective for distributing large files efficiently. Magnet links are a user-friendly way to download torrents, as they don't require the actual torrent file to start downloading content. 2. **Main Nodes on Residential Wi-Fi**: This is an innovative approach to seeding torrents. By distributing the main nodes across various locations, you not only enhance the resilience and redundancy of the system but also distribute the load, which can improve download speeds and availability. 3. **Qubes OS for Security**: Using Qubes, a security-oriented operating system, for running your nodes is a smart choice. It allows you to compartmentalize different functions (like VPN connections and the BitTorrent client) into separate, isolated VMs, reducing the risk of security breaches. 4. **VPN for Anonymity**: The use of distinct VPN accounts for each main node is crucial for maintaining anonymity and preventing bottlenecks. This setup can protect the node operators and the system from legal and security issues. 5. **Scalability**: The idea to scale the system by cloning and deploying more main nodes as needed is feasible and aligns with the principles of decentralized networks. This elasticity is key to handling varying loads efficiently. ### Challenges and Considerations 1. **Legal and Ethical Considerations**: Depending on the content being shared, there could be legal implications for you and the node operators. Ensuring that the system is used for legally permissible purposes is critical. 2. **Technical Complexity**: Setting up and managing a decentralized network with Qubes, VPNs, and multiple nodes can be technically challenging. It requires expertise in networking, security, and system administration. 3. **Cost**: While decentralized, the initial setup and ongoing maintenance of main nodes, especially the VPN subscriptions and potential hardware requirements, could become costly. 4. **User Adoption and Network Effect**: For the system to be efficient, a critical mass of users is needed to distribute the load effectively. Encouraging users to not only download but also seed files is essential. 5. **Performance and Reliability**: The performance of your system heavily depends on the residential internet connections and the reliability of the VPN services used. Variability in these services could affect the user experience. 6. **Security Risks**: Despite the security measures, operating such a system comes with inherent risks, especially if security vulnerabilities are discovered in the software used or if node operators' VPN connections are compromised. In summary, your idea is technically feasible and aligns with the principles of decentralized file distribution. However, the implementation will require careful planning, especially regarding security, legal considerations, and operational logistics. It’s an ambitious project that could offer a robust solution for decentralized file sharing if executed correctly.

Patrick Lambert

Me: I have an idea for a decentralized setup to distribute files. I'm wondering if it's feasible. It would be like this: * The site would be hosted on a server somewhere that I pay for. It would have magnet links for the files users would want to get. * The torrents will have a single or several main nodes that will ensure that the files are being seeded. * The main nodes will be off residential wifi. It will have a setup like this: A server running qubes with a VPN qube and the bittorrent qube. The main nodes will be run on several different wifi networks at different homes. The VPN will also have a unique account for each main node to ensure no bottleneck. * As users download and seed the torrents it should reduce bandwidth on the main nodes. And if the main nodes become overloaded, it can scale upwards by cloning the computer and deploying more main nodes.

Patrick Lambert

I thought about it a little more today while I was at work. I think it's feasible. Here's a short conversation I had about it with chatgpt.

Patrick Lambert

What about a peer to peer setup? You could have a local setup. Maybe use qubes with a VPN. Once people have the files they can help relieve the bandwidth on your local network. If people don't seed as much you can create clones of the qube and deploy it to other networks to reduce bandwidth.

Patrick Lambert

Maybe AWS? Not sure if this is viable?

Nurul Basher

Thank you so much for your support. Really meant a lot for us :)

The Comic Guy

I'm stepping up my monthly donation and I'm backing whatever decision you make and suits better. I also share the believe that, reliability over speed is the ideal way to go. Thank you for the hard work.

Felipe C. E Silva

Like others, I'm very ignorant on file serving. I will NOT pull my monthly account, because your site is amazing. I **love** having comics at my fingertips at any time. I agree with others that I'd prefer reliability over speed.

David Jenks

I don't know if something like Proton is a viable option but if it moves to Google Drive and limits the archive, I'd understand. The cloud is getting greedier since suddenly an unlimited option doesn't bring extra money.

Omega Johnson

Thank you :)

The Comic Guy

Well noted, thank you mate.

The Comic Guy

Apologies for the late reply. In total, about 11 TB.

The Comic Guy

After all the job keeping the page whatever suits you better!!

Ramonchu

Well !!! I'm not a expert. Everything that is easier and more convenient for you .

Ramonchu

I'm OK with dropbox/google for the time being. I support the idea of locating a more stable, long-term solution where you will not be hit with these storage problems. Agree with others that long-term stability/not having to look over your shoulder is preferred over fast downloads.

Michael E. Brown

Ah sorry. I totally missed that somehow. Quick question. Is Pixeldrain a good candidate for the entire Dropbox shared folder or is it only good for single/small uploads?

Siladitya Ray

how large is the 'unlimited' archive at this time?

Duarte Carreira

Are you suggesting hosting the files yourself?

Paul Dorai-Raj

Thanks Simon for contributing books from Titan and Vault, publishers I wasn't even aware of. Really enjoyed a lot of the content!

Paul Dorai-Raj

It still requires a host to provide the bandwidth, but it does have it advantages in terms of anonymity I'd guess. Good idea, but I think there are simply too many non-subscribers downloading content to opt for anything other than a hosting/bandwidth provider that provides the most bang for buck. I have noticed files not being available on Mega, but there always seems to be at least one host with the required files. Only you really know what is economically feasible. Does the ad revenue justify offering the content for free?

Paul Dorai-Raj

Well noted, thank you for your comment :)

The Comic Guy

I also not sure, thus I create this poll/post. So, that there's some idea or suggestion on what platform that I use :)

The Comic Guy

Unless you have a hutrungous NAS system that can only be accessed by 'backers', I'm not tech or VPN savvy enough to give any suggestions

Desmond Auer

Is there really nothing like Proton Mail as a VPN that has larger (anonymous) hosting storage? I wonder if you contacted Proton if they'd be willing to work with you on this. Maybe that's not necessary....do we/you generate enough income to run our/your own server (min-farm)?

Gerrit Hutink

Well noted, thank you :)

The Comic Guy

Really appreciate it, mate. Thank you so much

The Comic Guy

Well noted, thank you for the comment :)

The Comic Guy

Well noted, thank you

The Comic Guy

It does, unfortunately last time I check, the sharing options is pretty limited. Will be checking again, soon. Thank you for the recommendation.

The Comic Guy

Any suggestion? Or are you prefer something like FTP?

The Comic Guy

Unfortunately, Proton Drive only have 3TB of storage space, max :(

The Comic Guy

Well noted, thank you for your recommendation :)

The Comic Guy

I end up using the website way more than Dropbox just because it is much easier to search on the website.

Cap'n Mahrrrvel

Im not that savvy with this but I will continue to support you in Patreon with whatever platform feel is the best option

Ron Bennett

I don't know what you should use, but it sounds like Dropbox and mega are poor options. Other people in the know have suggested some options at least. I'd go with reliability/safety over speed.

Dean Spencer

oops, didn't mean to post that just yet... What I was trying to say was -- However, I would ask that you consider a platform that allows me to contribute directly. Because *I* don't have a paid account on Dropbox, *my* Dropbox storage was "over my limit" and couldn't directly add new files from Titan or Vault as I came across them (nor could I, had I wanted to, just store my own files for myself on Dropbox, as the share was larger than my account allowed). (though, I'm also fine with continuing to send you files the way I have been)

Simon Jester

I'm fine Mega. I would like to be able to contribute directly, and have not been able to with Dropbox - because *I* don't have a paid account,

Simon Jester

Sync.com has an unlimited team option half the price of Dropbox (used to be) unlimited program...

Shane Zuspan

I was going to suggest that too, but I don't know how much trouble it would be to manage different uploads.

Eleni

I think we could live with decreased speed if that's going to solve the server problems.

Eleni

I want nothing to do with dropbox or any similar app.

James Dunnigan

Proton? I've not looked at their storage and bandwidth limits, but as they're also a vpn with a focus on privacy I would imagine they're probably no too bad regarding takedown notices

Loz Hensel

Mega isn't a great solution. I've had issues with them in the past. If you want to go old school look into UseNet or IRC.

Josip Benko

I tried nextcloud few years ago, but the sharing option isn't as robust. But I might have to take a look at it again. Amazon S3 is really expensive on outgoing traffic (if I recall correctly). Thank you for the suggestion, I will check on it again :)

The Comic Guy

I never heard of FileCat. Will be looking into it. Thank you :) -- Update: Unfortunately FileCat only offer 1 TB of storage space on its plan :(

The Comic Guy

Not sure how tech savvy you are but you could also setup your own dropbox using a tool called nextcloud combined with amazon s3 as the storage backend. But there has to be a solution that already works off the bat

Malcolm Jones

I would look into 1fichier and FileCat. Both offer good services, however, FC seems to be quite resilient to takedowns.

TaReNT

I am not sure, when was the last time you visit the site. But we already using Pixeldrain for months :)

The Comic Guy

No I haven't. Will be checking it out :)

The Comic Guy

Have you looked at Pixeldrain? I've seen it being used on a ton of file sharing sites. File retention seems pretty solid even for large folders. Download speeds are good too.

Siladitya Ray

Have you considered using I drive ?

Tony Watterson

I really can't give you any advice on this issue. I can just wish you luck in making the right decision

Mario Aandewiel

reliability over speed would be my preference. Also easy maintenance would be a plus I guess

Stompie

Well noted, thank you.

The Comic Guy

I think it'd probably be best to see what happens regarding Dropbox before committing to a switchover. That said, preparing a backup mega couldn't hurt.

Tadpoleon

Hi. Mega is really strict with the takedown issue. 3 takedown request in a row from anyone, and they suspend our account right away. Unfortunately, switching to mega will not restore the broken link in the site.

The Comic Guy

Well noted, thank you.

The Comic Guy

FTP is an option, although the speed really dependent on the server & client location. Thank you for the suggestion.

The Comic Guy

Regarding a switch to Mega... I bought a month subscription to supplement my Patreon membership with you. Why? Better download speeds. But.... most times I tried Mega for the last couple of weeks I get told the file is no longer available. Will your switch restore the files?

MikeN

I think the sheer volume will always attract attention on one platform. Probably better to divide and conquer and use multiple platforms. Maybe a server with dedicated storage would be an alternative.

Stompie

What about switching to a FTP hoster with unlimited bandwith? This would also mean an easier way of selectively downloading

Oliver Stadler


More Creators