- RAS-run - RePEc Lists

obfuscation module
by Thomas Krichel 17 Feb '23

17 Feb '23

This is the module. I return the prefix REPEC, if a shift has happened. make() makes the obfuscated handle. ekam() is the opposite, for testing. JMBC can perlify. I tested this on about 97000 handles from ArchEc. -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21077th day. ## obfuscate.py import datetime class Obfuscate: def __init__(self, do_verbose=False): return None def from_file(self, fufi, cut): """testing routine, can be deleted""" ## read handles from a file handles_file = open(fufi, 'r') while True: line = handles_file.readline() if not line: break self.work_on_line(line.strip(), cut) return None def work_on_line(self, line, cut): # # in case we have a prefix of the handle old = line[cut:] new = self.make(old) check = self.ekam(new) check_lc = check.lower() old_lc = old.lower() if not check_lc == old_lc: raise Exception(f"inconsistency on {old} --> {new}") def make(self, old): """main function used by external callers""" if not (old.startswith('repec') or old.startswith('RePEc')): print(old) quit() old_date = old[10:20] if old == 'RePEc:per': return old try: old_parsed = datetime.datetime.strptime(old_date, '%Y-%m-%d') except ValueError: return old year = int(old_parsed.strftime("%Y")) if year < 1900: # # early dates could be confusing because of changes # # in adoption of Greogian calendar return old if year > 2100: # # I see no reason to obfuscate these return old shift = len(old) if shift % 2 == 1: # # for odd values, take negative shift = -shift new_parsed = old_parsed + datetime.timedelta(days=shift) new_date = new_parsed.strftime("%Y-%m-%d") new = old.replace(old_date, new_date, 1) new = new.replace('repec', 'REPEC') new = new.replace('RePEc', 'REPEC') return new def ekam(self, new): """opposite of make, a check""" if new == 'RePEc:per': return new if not new.startswith('REPEC'): return new new_date = new[10:20] new_parsed = datetime.datetime.strptime(new_date, '%Y-%m-%d') shift = len(new) if shift % 2 == 0: # # for even values, take negative shift = -shift old_parsed = new_parsed + datetime.timedelta(days=shift) old_date = old_parsed.strftime("%Y-%m-%d") old = new.replace('REPEC', 'RePEc') old = old.replace(new_date, old_date) return old

1 0

authors@repec.org
by Christian Zimmermann 28 Jan '23

28 Jan '23

Thomas, you can remove me from the forwarding. Thanks. Christian Zimmermann

2 1

email forward
by Christian Zimmermann 18 Jan '23

18 Jan '23

Thomas, can you add team(a)mail.authors.repec.org to the forward for authors.(a)repec.org? I want to start training the filters. Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist @CZimm_economist@econtwitter.net

2 1

Re: [RAS] AWS workmail
by Thomas Krichel 15 Jan '23

15 Jan '23

Christian Zimmermann writes > I need the following in the DNS: I am awfully sorry. I was out all day today. working on this. binder@iripa:~$ tail -10 bind/repec.db ;; CZ 2023-01-13 _amazonses.authors 300 TXT "9jpG/tX8BUEKEeYbso7sSAwBXFXxf3tgXrZNSyYstJQ=" authors 300 MX 10 inbound-smtp.us-east-1.amazonaws.com. autodiscover.authors 300 CNAME autodiscover.mail.us-east-1.awsapps.com. bwf33k6glwvy3j5cbdmykj2qv7af3tdj._domainkey.authors 300 CNAME bwf33k6glwvy3j5cbdmykj2qv7af3tdj.dkim.amazonses.com. tr24onbel6ybpqd6glzzhuzj73xwja5w._domainkey.authors 300 CNAME tr24onbel6ybpqd6glzzhuzj73xwja5w.dkim.amazonses.com. tmldwjtv5plbhrlr4d44xxfvw7ruikji._domainkey.authors 300 CNAME tmldwjtv5plbhrlr4d44xxfvw7ruikji.dkim.amazonses.com. authors 300 TXT "v=spf1 include:amazonses.com ~all" _dmarc.authors 300 TXT "v=DMARC1;p=quarantine;pct=100;fo=1" > > _amazonses.authors.repec.org. 300 TXT > "9jpG/tX8BUEKEeYbso7sSAwBXFXxf3tgXrZNSyYstJQ=" > authors.repec.org. 300 MX 10 inbound-smtp.us-east-1.amazonaws.com. > autodiscover.authors.repec.org. 300 CNAME > autodiscover.mail.us-east-1.awsapps.com. > bwf33k6glwvy3j5cbdmykj2qv7af3tdj._domainkey.authors.repec.org. 300 CNAME > bwf33k6glwvy3j5cbdmykj2qv7af3tdj.dkim.amazonses.com. > tr24onbel6ybpqd6glzzhuzj73xwja5w._domainkey.authors.repec.org. 300 CNAME > tr24onbel6ybpqd6glzzhuzj73xwja5w.dkim.amazonses.com. > tmldwjtv5plbhrlr4d44xxfvw7ruikji._domainkey.authors.repec.org. 300 CNAME > tmldwjtv5plbhrlr4d44xxfvw7ruikji.dkim.amazonses.com. > authors.repec.org. 300 TXT "v=spf1 include:amazonses.com ~all" > _dmarc.authors.repec.org. 300 TXT "v=DMARC1;p=quarantine;pct=100;fo=1" > > Thanks! > > Christian Zimmermann FIGUGEGL! > Economic Research > Federal Reserve Bank of St. Louis > P.O. Box 442 > St. Louis MO 63166-0442 USA > https://ideas.repec.org/zimm/ @CZimm_economist @CZimm_economist@econtwitter.net -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21043rd day.

2 17

handle obfuscation
by Thomas Krichel 12 Jan '23

12 Jan '23

Christian Zimmermann writes > First meeting of the year Following off that meeting, I have come with a simple way to obfuscate dates in handles. Just use the length of a handle as a delta. Thus if the handle is RePEc:per:1965-06-05:thomas_krichel move it to RePEc:per:1965-07-10:thomas_krichel since the length of the handle is 35 characters. If this something you would do, I can write a piece of python than would implement conversions. I'm not sure whether this would work if we have fictious dates in the data, like 1965-06-31. I could run a test on the current RAS data. -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21041st day.

1 1

site back up
by Christian Zimmermann 13 Dec '22

13 Dec '22

after killing all crons and jobs. So nothing updates for a while until I gradually put things back on. But users can log in and change records. Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist @CZimm_economist@econtwitter.net

1 0

RAS down again
by Christian Zimmermann 12 Dec '22

12 Dec '22

We may have mismatches between MySQL and XML creating havoc. Thinking of going back to a full, earlier backup. Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist @CZimm_economist@econtwitter.net

1 0

RAS down
by Christian Zimmermann 09 Dec '22

09 Dec '22

RAS is down, because the volume holding the MySQL database filled much faster than expected. We hope to have it back up tomorrow, but it looks like a few hours of new data will be lost. Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist @CZimm_economist@econtwitter.net

1 0

mail about justin@repec.org
by Thomas Krichel 29 Sep '22

29 Sep '22

Does this come from RAS? ----- Forwarded message from justin(a)repec.org ----- Return-path: <01000183875aa1c3-170254ff-5581-41cb-b740-4ff60befe92f-000000(a)amazonses.com> Envelope-to: krichel(a)openlib.org Delivery-date: Thu, 29 Sep 2022 03:46:56 +0000 Received: from iripa.openlib.org ([2a01:4f8:10b:1a2b::2]) by helos.openlib.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from <01000183875aa1c3-170254ff-5581-41cb-b740-4ff60befe92f-000000(a)amazonses.com>) id 1odkVj-00Gpnh-Mm for krichel(a)openlib.org; Thu, 29 Sep 2022 03:46:56 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=repec.org; s=all; h=Date:Message-ID:Subject:From:To:Sender:Reply-To:Cc:MIME-Version: Content-Type:Content-Transfer-Encoding:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=R+8oHJM/lPQFPEWO+ckPhYJQqglzqt4xnmS8m3ONpeU=; b=Pe8Ll0yjnhGqKVZh3pKEDd0WBE uFEN02OKm77W3A3Zt/+v4X+k33bjDR4e4eTT2JSGEW8snGvJH5hd6hVRGD9mM1gerQaDPGjryyroC ZhPUWgIDY9+CewRbmRIq90pG0YWfgRg/61l42PCrh1y+2ChdCDXIEY6QuQck7+alASdE=; Received: from a48-102.smtp-out.amazonses.com ([54.240.48.102]) by iripa.openlib.org with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA (Exim 4.96) (envelope-from <01000183875aa1c3-170254ff-5581-41cb-b740-4ff60befe92f-000000(a)amazonses.com>) id 1odkVe-007Q0t-2E for root(a)repec.org; Thu, 29 Sep 2022 03:46:55 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=6gbrjpgwjskckoa6a5zn6fwqkn67xbtw; d=amazonses.com; t=1664423207; h=To:From:Subject:Message-Id:Date:Feedback-ID; bh=R+8oHJM/lPQFPEWO+ckPhYJQqglzqt4xnmS8m3ONpeU=; b=XMzNkYEazDYbze2ybhNj5PgeAVhWQaFyH8ch2PadaQ/uf4lwYiAO0nVjV2KpqvOY bgPVDzaer5c/i1glW2pbgzc6gHFJS459k/gvndq7w4etrLabULa9MuJY9hetyGSUAm6 PoLINUv5zJu0tT7sg6DyjwTPksX+M/6Pf8q7Srv4= To: root(a)repec.org From: justin(a)repec.org Auto-Submitted: auto-generated Message-ID: <01000183875aa1c3-170254ff-5581-41cb-b740-4ff60befe92f-000000(a)email.amazonses.com> Date: Thu, 29 Sep 2022 03:46:47 +0000 Feedback-ID: 1.us-east-1.eZVK1JbXJOEenNbyeaPfXd8IuVxQYSKRt4Tv6rln4Dc=:AmazonSES X-SES-Outgoing: 2022.09.29-54.240.48.102 X-SA-Exim-Connect-IP: 2a01:4f8:10b:1a2b::2 X-SA-Exim-Mail-From: 01000183875aa1c3-170254ff-5581-41cb-b740-4ff60befe92f-000000(a)amazonses.com X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on helos.openlib.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=4.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 Subject: *** SECURITY information for ip-10-121-55-235 *** X-SA-Exim-Version: 4.2.1 (built Tue, 16 Feb 2021 15:21:40 +0000) X-SA-Exim-Scanned: Yes (on helos.openlib.org) ip-10-121-55-235 : Sep 28 22:50:19 : justin : user NOT in sudoers ; TTY=pts/0 ; PWD=/home/justin ; USER=root ; COMMAND=/bin/bash ----- End forwarded message ----- -- Cheers, Thomas Krichel http://openlib.org/home/krichel skype:thomaskrichel

2 6

Re: [RAS] [PosibleSPAM] Re: [MAILER-DAEMON@amazonses.com: Delivery Status Notification (Failure)]
by Christian Zimmermann 12 Sep '22

12 Sep '22

We have not started with that yet and have not stopped this service on the server side. Christian Zimmermann FIGUGEGL! Economic Research Federal Reserve Bank of St. Louis P.O. Box 442 St. Louis MO 63166-0442 USA https://ideas.repec.org/zimm/ @CZimm_economist On Mon, 12 Sep 2022, Jose Manuel Barrueco wrote: > > > As far as I remember the stop wasn't related to access issues, but to > a decission to rebuild the RAS service... > > > > On Mon, 12 Sep 2022, Thomas Krichel wrote: > >> Jose Manuel Barrueco writes >> >>> Actually, the data transfer from RAS to CitEc stoped in February. >> >> No host key changes at iripa >> >> root@iripa ~ # ls -l /etc/ssh/ssh_host_* >> -rw------- 1 root root 227 Aug 8 2017 /etc/ssh/ssh_host_ecdsa_key >> -rw-r--r-- 1 root root 172 Aug 8 2017 /etc/ssh/ssh_host_ecdsa_key.pub >> -rw------- 1 root root 399 Aug 8 2017 /etc/ssh/ssh_host_ed25519_key >> -rw-r--r-- 1 root root 92 Aug 8 2017 /etc/ssh/ssh_host_ed25519_key.pub >> -rw------- 1 root root 1.7K Aug 8 2017 /etc/ssh/ssh_host_rsa_key >> -rw-r--r-- 1 root root 392 Aug 8 2017 /etc/ssh/ssh_host_rsa_key.pub >> >> >> -- >> >> Cheers, >> >> Thomas Krichel http://openlib.org/home/krichel >> skype:thomaskrichel >> > > > --- > Josï¿œ Manuel Barrueco > @JMBarrueco > Servei de Biblioteques i Documentaciï¿œ > Universitat de Valï¿œncia > > Tlf: +34963983359 > http://www.uv.es/=barrueco >

1 0