etherdump issueshttps://gitlab.constantvzw.org/aa/etherdump/-/issues2021-05-20T14:07:40Zhttps://gitlab.constantvzw.org/aa/etherdump/-/issues/7urlencode update2021-05-20T14:07:40Zdickreckardurlencode updatehttps://techoverflow.net/2015/02/08/fixing-importerror-cannot-import-name-urlencode-in-python3/
this
```
from urllib import urlencode
```
should probably become this
```
try:
from urllib import urlencode
except ImportError:
fr...https://techoverflow.net/2015/02/08/fixing-importerror-cannot-import-name-urlencode-in-python3/
this
```
from urllib import urlencode
```
should probably become this
```
try:
from urllib import urlencode
except ImportError:
from urllib.parse import urlencode
```
and probably this
```
from urllib2 import urlopen, HTTPError, URLError
```
should become this
```
try:
from urllib2 import urlopen, HTTPError, URLError
except ImportError:
from urllib.request import urlopen, HTTPError, URLError
```
or at least it works for the creatediffhtml command ^^https://gitlab.constantvzw.org/aa/etherdump/-/issues/4Make `--meta` honour `--publish/nopublish` setting2019-03-16T12:30:55Zdecentral1seMake `--meta` honour `--publish/nopublish` settingIf I have `etherdump pull --meta --publish-opt-in`, then I expect to only get the metadata from the pads that I have `__PUBLISH__` on. This comes from experimenting with https://gitlab.constantvzw.org/aa/etherdump/issues/3. Will get a pa...If I have `etherdump pull --meta --publish-opt-in`, then I expect to only get the metadata from the pads that I have `__PUBLISH__` on. This comes from experimenting with https://gitlab.constantvzw.org/aa/etherdump/issues/3. Will get a patch in ... ;)https://gitlab.constantvzw.org/aa/etherdump/-/issues/3__PUBLISH__ vs. __NOPUBLISH__2020-06-02T07:49:21Zdecentral1se__PUBLISH__ vs. __NOPUBLISH__Further discussion at Varia are leading to a need to have `etherdump` only start the archiving work if it recognizes a `__PUBLISH__` marker on a pad. This is following conversations about privacy and ideas of what publishing means which ...Further discussion at Varia are leading to a need to have `etherdump` only start the archiving work if it recognizes a `__PUBLISH__` marker on a pad. This is following conversations about privacy and ideas of what publishing means which I won't burden you all with ;) So, just opening this here to show what patch I might come up with in case it is useful!https://gitlab.constantvzw.org/aa/etherdump/-/issues/2Running `addtext` across all pads2020-06-02T07:49:22Zdecentral1seRunning `addtext` across all padsAfter getting https://gitlab.constantvzw.org/aa/etherdump/merge_requests/1 done, I was able to do something like:
```bash
$ apt install -y jq
$ etherdump init
$ etherdump pull --meta --pub .etherdump
$ cat .etherdump/*.meta.json | jq '....After getting https://gitlab.constantvzw.org/aa/etherdump/merge_requests/1 done, I was able to do something like:
```bash
$ apt install -y jq
$ etherdump init
$ etherdump pull --meta --pub .etherdump
$ cat .etherdump/*.meta.json | jq '.padid' | xargs -I {} etherdump addtext {} "\n\n__NOPUBLISH\n\n" --append
$ rm .etherdump/*.meta.json
$ etherdump pull --meta --text --dhtml --pub .etherdump --no-raw-ext
```
And have `__NOPUBLISH__` honoured across every pad.
This could probably be made easier to do but wanted to see what you think.
Filtering was mentioned before and I think it would be nice to have something like:
```bash
$ etherdump filter --not "__NOPUBLISH__" # or whatever magic word ...
```
And that would return all the padIDs I need, which I could pipe into `etherdump addtext ...`.https://gitlab.constantvzw.org/aa/etherdump/-/issues/1Add new `addtext` command2020-06-02T07:49:23Zdecentral1seAdd new `addtext` commandHey! First of all - nice one! Etherdump is rad. :)
We're going to use this for [pad.vvvvvvaria.org](https://pad.vvvvvvaria.org/) and we have the situation that we would like to first exclude all pads from the archive (using the `__NOPUB...Hey! First of all - nice one! Etherdump is rad. :)
We're going to use this for [pad.vvvvvvaria.org](https://pad.vvvvvvaria.org/) and we have the situation that we would like to first exclude all pads from the archive (using the `__NOPUBLISH__` marker) and then selectively remove the marker and archive them as we go. It would be nice to have a command that automatically appends a custom message and the marker to all pads.
~~It could look like:~~ (Instead, see https://gitlab.constantvzw.org/aa/etherdump/issues/1#note_895)
```bash
$ etherdump nopublishall [--nopublish] "My custom message"`?
```
I thought it might be nice to upstream that here since it might also be useful for others who may have many existing pads for private uses and later want to use etherdump. Existing python API clients seem out of date and a command to do this on the database level is not always accessible to others (my other approaches ... ).
What do you think? If we're in agreement, I'll get working on it.