Archived copy. This is a static snapshot of the OPF community Q&A (qanda.digipres.org), preserved from its Question2Answer database. It is read-only and nothing here has been edited since capture in August 2026. To ask new questions, use the OPF community on GitHub.

Setting a custom date for wget or wpull?

votes

Both wget and wpull, when saving to WARC, will store the date and time of when the archiving action took place in every HTTP request.

Is there a way to modify this date, either during or after recording?

asked by

despens on 17 Dec 2015 · 334 views

2 answers

votes

One thing that certainly works is setting the system time on the host computer to the time frame that you want. We've done this and it worked well.

However, we've since become uncomfortable with having done it. Such WARCs are essentially lying, in that they look exactly like they were *really* taken in the past. If this is a common need, it would be better to have 'honest' WARCs that say the date they were taken and the date they are 'simulating', and extend the playback mechanisms to cope.

answered by

anjackson on 17 Dec 2015

votes

A useful analog may be our work on the SLAC web archive. In that case, we web-published then re-captured historical web content with wget into WARC, then adulterated the CDX indices to reflect the "true" timestamps corresponding to the dates of the backups from which we restored the web content. That way, we had both a faithful record of the actual HTTP communications in the WARCs and timestamp-appropriate indexing for the purposes of access.

answered by nullhandle on 17 Dec 2015