HTML Logo by World Wide Web Consortium (www.w3.org). Click to learn more about our commitment to accessibility and standards.

Moving forward with Composr

ocPortal has been relaunched as Composr CMS, which is now in beta. ocPortal 9 will be superseded by Composr 10.

Head over to compo.sr for our new site, and to our migration roadmap. Existing ocPortal member accounts have been mirrored.


Import Filesystem Files: Any way to process files like standard uploads?

Login / Search

 [ Join | More ]
 Add topic 
Posted
Rating:
#108610 (In Topic #21164)
TQ
Avatar

Honoured member

Hi All,

I have acquired about 500 pdf documents (service manuals amounting to about 2Gb of data) and would love to bulk add them to the site.

I would like to avoid adding/uploading each file individually so I have investigated 'Import Filesystem Files' which is almost perfect for my needs but for one major thing, it does not encrypt the filenames to .dat files and map them accordingly in the db.

Unless I've misinterpreted the function of the 'Bulk-Upload Assistant', that won't help me either.

Can anyone suggest how I should best approch this task?

Many thanks

TQ
Back to the top
 
Posted
Rating:
#108611
Avatar

Hmm, yeah, that's a little tricky.

I checked the code.
If you import, it will store an absolute URL in the DB, which means the download code will download via an HTTP redirect to that URL, rather than through the dload.php script directly.

If you import, then run a MySQL REPLACE query to strip out the base URL, then place a .htaccess with deny's in the directory they're in, it should work.


Become a fan of ocPortal on Facebook or add me as a friend. Add me on on Twitter.
Was I helpful?
  • If not, please let us know how we can do better (please try and propose any bigger ideas in such a way that they are fundable and scalable).
  • If so, please let others know about ocPortal whenever you see the opportunity.
  • If my reply is too Vulcan or expressed too much in business-strategy terms, and not particularly personal, I apologise. As a company & project maintainer, time is very limited to me, so usually when I write a reply I try and make it generic advice to all readers. I'm also naturally a joined-up thinker, so I always express my thoughts in combined business and technical terms. I recognise not everyone likes that, don't let my Vulcan-thinking stop you enjoying ocPortal on fun personal projects.
  • If my response can inspire a community tutorial, that's a great way of giving back to the project as a user.
Back to the top
 
Posted
Rating:
#108620
TQ
Avatar

Honoured member

As always Chris, thanks for taking the time to look at my enquiry.

Now I've had time to go over the files I have been given, it would appear that there is a lot more work in preparing them than I first thought so the task of adding them to the site on an individual basis, whilst tedious, is not the lions share of the work. There is no deadline so I'll work through them an hour or two each day until I get to the end.

The encrypted file name is, in my opinion, a brillent feature so I don't want to deviate away from it.

I'm also mindful of keeping the site as generic as possible to minimise the pain when v10 is released and I face the challenge of upgrading.

Many thanks
TQ
Back to the top
 
1 guests and 0 members have just viewed this: None
Control functions:

Quick reply   Contract

Your name:
Your message: