Hi, we have got the same problems with 213.80.128.0/17 14.06.2012 11:24, Erdenreich, Florian написал:

Hi,

we have got the same problems with 213.165.96/19

Mit freundlichem Gruß,

Florian Erdenreich Dipl.-Inf.(FH)

------------------------------------- Erdenreich Datentechnik ...the way your net works

Jesuitenstraße 9 85049 Ingolstadt Tel: +49 841 9933909-0 Fax:+49 841 9933909-10

[Inhaber: Dipl.-Inf.(FH) Florian Erdenreich, UST-ID DE814774620 Steuer-Nr: 154 215 40192]

________________________________________ Von: members-discuss-bounces@ripe.net [members-discuss-bounces@ripe.net]" im Auftrag von "Raymond Dijkxhoorn [raymond@prolocation.net] Gesendet: Donnerstag, 14. Juni 2012 08:31 An: members-discuss-bounces@ripe.net Cc: Jørgen Hovland; members-discuss@ripe.net Betreff: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server

Hi!

...

after the issue the ripe services had today evening, we still have one network whre delegation for reverse is still not working.

Of course this is a nightmare as all mail traffic is affected.

Anyone know a way to contact ripe support outside of office hours ?

Jun 14 07:23:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:24:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:26:06 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:27:09 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:38:10 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 202.12.28.140 for DS 179.212.in-addr.arpa. while building chain of trust

This still was happening on several zones up to one hour ago. Since this is impacting the real world pretty badly i would expect a bit more fuzz. Mailflows are impacted with this, providers rejecting mails due to missing and/or invalid rdns...

Bye, Raymond.

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses. ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

-- С уважением, Ведущий инженер сектора эксплуатации IP-сети и телематических служб ЗАО "ТТК-Волга" Денис Михлевич т.раб: (8452) 39-45-19 т.сот: (937) 222-90-84

Hi, I 've phoned with the RIPE NCC. The problem is known and will be fixed shortly... Mit freundlichen Grüßen, Florian Erdenreich Dipl.-Inf.(FH) ========================================================== Support: (Mo.-Fr. 08:30 - 12:00 und 13:00 - 18:00): 0841 / 99 33 909-0 Erdenreich Datentechnik ...the way your net works Jesuitenstraße 9 85049 Ingolstadt Tel: +49 841 99 33 909-0 Fax: +49 841 99 33 909-10 Inhaber: Dipl.-Inf.(FH) Florian Erdenreich, UST-ID: DE814774620 Steuer-Nr: 154 215 40192 -----Ursprüngliche Nachricht----- Von: Giuseppe Tanzilli - Serverplan [mailto:giuseppe@serverplan.com] Gesendet: Donnerstag, 14. Juni 2012 10:23 An: Erdenreich, Florian Cc: Raymond Dijkxhoorn; members-discuss-bounces@ripe.net; Jørgen Hovland; members-discuss@ripe.net Betreff: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server Hi, we solved the reverse issue updating the delegation object in ripe database, modified just the changed field, few minutes later the zone was visible. Hope that helps. Anyway I think we must ask RIPE NCC for a H24 techical phone number for events like this, every provider has an H24 service for issues of this magnitude. It is not acceptable that ripe ncc, does not have one. Giuseppe Il 14/06/2012 09:24, Erdenreich, Florian ha scritto:

Hi,

we have got the same problems with 213.165.96/19

Mit freundlichem Gruß,

Florian Erdenreich Dipl.-Inf.(FH)

------------------------------------- Erdenreich Datentechnik ...the way your net works

Jesuitenstraße 9 85049 Ingolstadt Tel: +49 841 9933909-0 Fax:+49 841 9933909-10

[Inhaber: Dipl.-Inf.(FH) Florian Erdenreich, UST-ID DE814774620 Steuer-Nr: 154 215 40192]

________________________________________ Von: members-discuss-bounces@ripe.net [members-discuss-bounces@ripe.net]" im Auftrag von"Raymond Dijkxhoorn [raymond@prolocation.net] Gesendet: Donnerstag, 14. Juni 2012 08:31 An: members-discuss-bounces@ripe.net Cc: Jørgen Hovland; members-discuss@ripe.net Betreff: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server

Hi!

...

after the issue the ripe services had today evening, we still have one network whre delegation for reverse is still not working.

Of course this is a nightmare as all mail traffic is affected.

Anyone know a way to contact ripe support outside of office hours ? Jun 14 07:23:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:24:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:26:06 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:27:09 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:38:10 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 202.12.28.140 for DS 179.212.in-addr.arpa. while building chain of trust

This still was happening on several zones up to one hour ago. Since this is impacting the real world pretty badly i would expect a bit more fuzz. Mailflows are impacted with this, providers rejecting mails due to missing and/or invalid rdns...

Bye, Raymond.

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses. ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

-- -------------------------------------------------- Giuseppe Tanzilli Serverplan

If I remember correctly, there should be a mail-address sos@ripe.net and ops@ripe.net for this kind of urgent/technical issues. -----Original message----- Hi, we solved the reverse issue updating the delegation object in ripe database, modified just the changed field, few minutes later the zone was visible. Hope that helps. Anyway I think we must ask RIPE NCC for a H24 techical phone number for events like this, every provider has an H24 service for issues of this magnitude. It is not acceptable that ripe ncc, does not have one. Giuseppe Il 14/06/2012 09:24, Erdenreich, Florian ha scritto:

Hi,

we have got the same problems with 213.165.96/19

Mit freundlichem Gruß,

Florian Erdenreich Dipl.-Inf.(FH)

------------------------------------- Erdenreich Datentechnik ...the way your net works

Jesuitenstraße 9 85049 Ingolstadt Tel: +49 841 9933909-0 Fax:+49 841 9933909-10

[Inhaber: Dipl.-Inf.(FH) Florian Erdenreich, UST-ID DE814774620 Steuer-Nr: 154 215 40192]

________________________________________ Von: members-discuss-bounces@ripe.net [members-discuss-bounces@ripe.net]" im Auftrag von"Raymond Dijkxhoorn [raymond@prolocation.net] Gesendet: Donnerstag, 14. Juni 2012 08:31 An: members-discuss-bounces@ripe.net Cc: Jørgen Hovland; members-discuss@ripe.net Betreff: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server

Hi!

...

after the issue the ripe services had today evening, we still have one network whre delegation for reverse is still not working.

Of course this is a nightmare as all mail traffic is affected.

Anyone know a way to contact ripe support outside of office hours ? Jun 14 07:23:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:24:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:26:06 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:27:09 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure<102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:38:10 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 202.12.28.140 for DS 179.212.in-addr.arpa. while building chain of trust

This still was happening on several zones up to one hour ago. Since this is impacting the real world pretty badly i would expect a bit more fuzz. Mailflows are impacted with this, providers rejecting mails due to missing and/or invalid rdns...

Bye, Raymond.

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses. ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

-- -------------------------------------------------- Giuseppe Tanzilli Serverplan ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

On 06/14/2012 10:36 AM, Dennis Yusupoff wrote:

14.06.2012 12:22, Giuseppe Tanzilli - Serverplan написал:

...

Anyway I think we must ask RIPE NCC for a H24 techical phone number for events like this, every provider has an H24 service for issues of this magnitude.

It is not acceptable that ripe ncc, does not have one. +1, good idea.

I expect they already have some kind of "noc"? Imagine what might happen if people really start to use ressource-certification (I personally don't like the idea behind those signatures) and on a Friday the whole internet goes down because all routes from the RIPE-region are invalid .-) Kind regards, Stefan Neufeind PS: This is just my personal opinion, not necessarily the one of my employer.

Anyway I think we must ask RIPE NCC for a H24 techical phone number for events like this, every provider has an H24 service for issues of this magnitude.

It is not acceptable that ripe ncc, does not have one.

As RIPE is also connected to the internet (and the AMS-iX for instance) I'm pretty sure that they have a 24*7 standby already in place. People from the team of Romeo Zwart are mentioned in the peeringdb for AS AS25152 as contacts. ( the AS for the K-root servers ) http://www.ripe.net/lir-services/ncc/staff/gii And according to the company structure (http://www.ripe.net/lir-services/ncc/staff/ripe-ncc-staff-structure) they fall under the Chief Scientist Daniel Karrenberg. As Romeo recently joined RIPE, this might be a nice moment to introduce himself to the community and provide some insight in his new role and if his team doesn't provide the 24*7 emergency contact, who is. And how they are doing this or going to do this. (Sorry to put you on the spot here mate ... ) Regards, Erik Bais

Well, then I will suggest that the information you posted as it currently stands was to terse or incomplete. We had e.g major issues with a range in 212.in-addr.arpa, which was not explicitly mentioned on these web-pages. All of them also referred to issues from yesterday, when there clearly was plenty of issues today. Everybody gets pissed when fuck-ups happens, since neither of us in the human-race are error free, good information always helps. Mvh stj. TDC AS Mobile: + 47 40 00 02 94 Direct: + 47 38 05 81 44 Fax : + 47 38 05 81 47 Ægirsv 10 N-4632 Kristiansand, Norway mailto:svein.tjemsland@tdc.no http://www.tdc.no -----Original Message----- From: members-discuss-bounces@ripe.net [mailto:members-discuss-bounces@ripe.net] On Behalf Of Daniel Karrenberg Sent: 14. juni 2012 12:18 To: Erik Bais Cc: Jørgen Hovland; Erdenreich, Florian; Giuseppe Tanzilli - Serverplan; Raymond Dijkxhoorn; members-discuss@ripe.net Subject: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server Since my name was mentioned in this thread ... Please be assured that we are working on any residual reverse DNS problems as I type this message. We do not post announcements regarding service disruptions to the members-discuss mailing list. We announce disruptions on our service announcement page as soon as any issue is discovered: http://www.ripe.net/lir-services/service-announcements Additionally this particular issue was announced on specific rDNS announcement page: http://www.ripe.net/lir-services/service-announcements/reverse-dns-services-... Because we expected significant impact of this particular incident we also mention it directly on the RIPE NCC's news and annoucments section on the homepage. We are working on the rDNS issue and would like to ask anyone who is experiencing problems relating to this to send reports to dns-help@ripe.net with details about what DNS responses you are getting and what the difference is to what you are expecting. Updates will be posted to the service pages mentioned above as soon as they are available and we will send updates to the dns-wg@ripe.net and ncc-announce mailing lists as necessary. We will also add any updates to our twitter feed @RIPE_NCC. Regarding the RIPE NCC's 24/7 procedures: we have 24/7 call out coverage in place for our infrastructure in general and for our DNS services in particular. All outages are monitored around the clock and our engineers respond swiftly to any incidents. We always announce that we are working on particular incidents as detailed above, as we did last night. We do not have a 24/7 call centre that can be contacted outside of regular office hours. After this particular incident is over, we will publish a post-mortem analysis. Daniel Karrenberg Chief Scientist RIPE NCC ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

I have just read this: https://labs.ripe.net/Members/dfk/timeline-of-reverse-dns-events And I'm shocked. The whole internet relies on the organization which clearly says: 14:00 Discovery that backups are not available How this is possible ? Regards, Jarek [ Swift Internet ] [ www.swiftinter.net ] [ Follow us on Twitter ] [ http://twitter.com/swiftinternet ] [ Check the latest updates on NOC ] [ http://noc.swiftinter.net ] [ tel: 0121 222 0500 ] [ fax: 0121 222 0510 ] [ support@swiftinter.net ] Linux registered user #368058 On 06/14/12 12:48, Daniel Karrenberg wrote:

On 14.06.2012, at 13:04, MB Registryno wrote:

...

Well, then I will suggest that the information you posted as it currently stands was to terse or incomplete.

We had e.g major issues with a range in 212.in-addr.arpa, which was not explicitly mentioned on these web-pages.

All of them also referred to issues from yesterday, when there clearly was plenty of issues today.

Everybody gets pissed when fuck-ups happens, since neither of us in the human-race are error free, good information always helps.

It certainly does. That's why we want to make sure that the information we pass out is actually good. Especially if Murphy stays around to strike multiple times, like he apparently did with us. Look at https://www.ripe.net/lir-services/service-announcements for an update with good information.

I am not amused either.

Vennlig hilsen

Daniel

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

Hi,

Am 19.06.12 17:18, schrieb [Swift Internet] Jarek Grzabel:

...

I have just read this: https://labs.ripe.net/Members/dfk/timeline-of-reverse-dns-events

And I'm shocked. The whole internet relies on the organization which clearly says: 14:00 Discovery that backups are not available

How this is possible ?

That was my personal "LOL WTF" moment of the day, too. I can vividly imagine the huge wave of facepalms that transcended the RIPE offices after this discovery.

actually, i like this. Backups are overrated and even if they exist, when does restoring the data ever work when you really need it to work? :-) </sarcasm> Considering the circumstances, i think the handling of the situation was quite good, and from a technical point of view, i couldn't have done anything better i guess (from what we know up to now). Of course, for those not on the relevant communication channels like IRC :-), the communication of what's happening should have been better for a big/long outage like this one, but that's actually my only problem with the whole incident (apart from the backup-thing) so far. Those things happen. I just hope the NCC learns some lessons, we get some more information about the root cause and what's being done to prevent this in the future, and i also hope there won't be too much ranting about this here or during the next AGM from C-Level droids. -- Mit freundlichen Grüßen / Kind Regards Sascha Lenz [SLZ-RIPE] Senior System- & Network Architect

On 19/06/2012 16:21, Dr. Christopher Kunz wrote:

Am 19.06.12 17:18, schrieb [Swift Internet] Jarek Grzabel:

...

I have just read this: https://labs.ripe.net/Members/dfk/timeline-of-reverse-dns-events

And I'm shocked. The whole internet relies on the organization which clearly says: 14:00 Discovery that backups are not available

How this is possible ? That was my personal "LOL WTF" moment of the day, too. I can vividly imagine the huge wave of facepalms that transcended the RIPE offices after this discovery.

It was far worse than that.... I raised my eyebrows at Daniel... he appreciated the seriousness Nigel

On 25/06/2012 23:14, Stefan Neufeind wrote:

On 06/25/2012 05:49 PM, Nigel Titley wrote:

...

On 19/06/2012 16:21, Dr. Christopher Kunz wrote:

...

Am 19.06.12 17:18, schrieb [Swift Internet] Jarek Grzabel:

...

I have just read this: https://labs.ripe.net/Members/dfk/timeline-of-reverse-dns-events

And I'm shocked. The whole internet relies on the organization which clearly says: 14:00 Discovery that backups are not available

How this is possible ? That was my personal "LOL WTF" moment of the day, too. I can vividly imagine the huge wave of facepalms that transcended the RIPE offices after this discovery.

It was far worse than that.... I raised my eyebrows at Daniel... he appreciated the seriousness Okay, but I really appreciate their openness. Problems (to put it polite) happen. So why find a wording around the facts ... face them and improve it.

Absolutely agree. There is never a value in not being open in our community. I fully support Axel and his team in their decision to publish the full facts of the matter. Of course I also expect to see a full report, in the fullness of time, on what exactly went wrong with their procedures and the steps taken to ensure that this doesn't happen again. Nigel

Hi!

we solved the reverse issue updating the delegation object in ripe database, modified just the changed field, few minutes later the zone was visible.

I'm probably not the only one testing this right now 8-} Did not yet work 8-( -- MfG/Best regards, Kurt Jaeger 8 years to go ! Dr.-Ing. Nepustil & Co. GmbH fon +49 7123 93006-0 pi@nepustil.net Rathausstr. 3 fax +49 7123 93006-99 72658 Bempflingen mob +49 171 3101372

Hi, They have a post on facebook. http://www.ripe.net/internet-coordination/news/announcements/update-regardin... Doesn't mention 212.in-addr.arpa. though (I have a range in that scope too and I also have the same problem). Regards Anders Olausson - SpaceDump IT AB

Does anyone get a feedback about the probleb from Ripe?

Similar for us, but only impacting our IPv6 netblock. Leland Vandervort Gandi SAS 63-65 Boulevard Massena 75013 Paris, France WWW: http://www.gandi.net/ T: +33 1 70 39 37 59 M: +33 6 31 15 15 07 On 14 Jun 2012, at 11:03, Ahmed Abdulraheem wrote:

Hello, I have called RIPE and they informed that they will fix this problem today,I am agreed to to you all that we should get 24/7 RIPE support

Regards,

Eng.Ahmad Abdul Rahim System Administrator S.A Department Tel.+965-808888-380 Qualitynet Co.

-----members-discuss-bounces@ripe.net wrote: ----- To: "igor.grinevich@vegatele.com" <igor.grinevich@vegatele.com>, Raymond Dijkxhoorn <raymond@prolocation.net>, "members-discuss-bounces@ripe.net" <members-discuss-bounces@ripe.net> From: Anders Olausson Sent by: members-discuss-bounces@ripe.net Date: 06/14/2012 12:00PM Cc: Jørgen Hovland <jorgen@ssc.net>, "members-discuss@ripe.net" <members-discuss@ripe.net> Subject: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server

Hi,

They have a post on facebook. http://www.ripe.net/internet-coordination/news/announcements/update-regardin...

Doesn't mention 212.in-addr.arpa. though (I have a range in that scope too and I also have the same problem).

Regards Anders Olausson - SpaceDump IT AB

...

Does anyone get a feedback about the probleb from Ripe?

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses. ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

Hi All God point... We have problems with 212.25.0.0/19, all 32 reverse delegations seam to be broken. Regards Matthias On 14/06/12 11:22, Job Snijders wrote:

Hi All,

I can imagine it would be VERY useful for RIPE NCC debugging if you specify WHICH zone exactly is still affected. Just mailing "works for me" or "doesn't work for me" doesn't narrow it down.

Kind regards,

Job

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

-- Matthias Cramer / mc322-ripe Senior Network & Security Engineer iway AG Phone +41 43 500 1111 Badenerstrasse 569 Fax +41 44 271 3535 CH-8048 Zürich http://www.iway.ch/ GnuPG 1024D/2D208250 = DBC6 65B6 7083 1029 781E 3959 B62F DF1C 2D20 8250

Hi, affected are: 86.117.212.in-addr.arpa 103.168.213.in-addr.arpa 124.168.213.in-addr.arpa Sending an update changed nothing so far. HTH, Michael Am 14.06.2012 11:22, schrieb Job Snijders:

Hi All,

I can imagine it would be VERY useful for RIPE NCC debugging if you specify WHICH zone exactly is still affected. Just mailing "works for me" or "doesn't work for me" doesn't narrow it down.

Kind regards,

Job

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

-- Michael Adams Tel: +49 221 2222 657 Network Engineering& Design Fax: +49 221 2222 7657 NetCologne Geschäftsführer Gesellschaft für Telekommunikation mbH Dr. Hans Konle (Sprecher) Am Coloneum 9 Dipl.-Ing. Karl-Heinz Zankel 50829 Köln HRB 25580, Amtsgericht Köln

What's the correct address to submit this information to anyway? I currently digging thru the LIR portal for a way to open a new ticket, but haven't found anything yet.

Guess that would be ops@ripe.net http://www.ripe.net/lir-services/ncc/contact/contact-us-by-email

Seeing residual issues in 62.73.128.0/19, and no service in 176.62.128.0/21, 213.212.64.0/18 looks to be back now Mike Simkins ▪ Senior Network Engineer , Operations Engineering ▪ SunGard Availability Services ▪ 25 Canada Square, London E14 5LQ Telephone: +1 (215) 446 2223 / +44 (0) 20 8081 2373 ▪Fax: +44 (0) 20 8081 2372 ▪ Mobile: +44 (0) 7710 677486 ▪ mike.simkins@sungard.com Customer Service Desk: +1 (800) 441 1181 ▪ sas.esupport@sungard.com Keeping People and Information Connected® ▪ http://www.sungardas.com/  Think before you print CONFIDENTIALITY: This e-mail (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this e-mail in error, please notify the sender and delete this e-mail from your system. -----Original Message----- From: members-discuss-bounces@ripe.net [mailto:members-discuss-bounces@ripe.net] On Behalf Of Alper SELÇUK | TEKNOTEL Sent: 14 June 2012 10:58 To: Thomas Jacob Cc: Michael Adams; members-discuss@ripe.net Subject: Re: [members-discuss] Reverse DNS issue - zone still not workingfromripe DNS server We've got problems with : 96.144.213.in-addr.arpa 97.144.213.in-addr.arpa Alper SELÇUK Genel Müdür Teknotel Telekomünikasyon A.Ş. Tel : +90 216 665 7700 Direk: +90 216 665 7721 GSM : +90 533 966 0140 www.teknotel.com 14 Haz 2012 tarihinde 12:42 saatinde, Thomas Jacob şunları yazdı:

We've got problems with

35.174.213.in-addr.arpa 36.174.213.in-addr.arpa

48.174.213.in-addr.arpa - 61.174.213.in-addr.arpa

Strangely to me this looks like a really old version of the database from a couple of years ago.

What's the correct address to submit this information to anyway? I currently digging thru the LIR portal for a way to open a new ticket, but haven't found anything yet.

On Thu, 2012-06-14 at 11:27 +0200, Michael Adams wrote:

...

Hi,

affected are:

86.117.212.in-addr.arpa 103.168.213.in-addr.arpa 124.168.213.in-addr.arpa

Sending an update changed nothing so far.

HTH, Michael

Am 14.06.2012 11:22, schrieb Job Snijders:

...

Hi All,

I can imagine it would be VERY useful for RIPE NCC debugging if you specify WHICH zone exactly is still affected. Just mailing "works for me" or "doesn't work for me" doesn't narrow it down.

Kind regards,

Job

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

We've got problems with 35.174.213.in-addr.arpa 36.174.213.in-addr.arpa 48.174.213.in-addr.arpa - 61.174.213.in-addr.arpa Strangely to me this looks like a really old version of the database from a couple of years ago. What's the correct address to submit this information to anyway? I currently digging thru the LIR portal for a way to open a new ticket, but haven't found anything yet. On Thu, 2012-06-14 at 11:27 +0200, Michael Adams wrote:

Hi,

affected are:

86.117.212.in-addr.arpa 103.168.213.in-addr.arpa 124.168.213.in-addr.arpa

Sending an update changed nothing so far.

HTH, Michael

Am 14.06.2012 11:22, schrieb Job Snijders:

...

Hi All,

I can imagine it would be VERY useful for RIPE NCC debugging if you specify WHICH zone exactly is still affected. Just mailing "works for me" or "doesn't work for me" doesn't narrow it down.

Kind regards,

Job

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

Hi, affected are: 86.117.212.in-addr.arpa 103.168.213.in-addr.arpa 124.168.213.in-addr.arpa Sending an update changed nothing so far. HTH, Michael Am 14.06.2012 11:22, schrieb Job Snijders:

Hi All,

I can imagine it would be VERY useful for RIPE NCC debugging if you specify WHICH zone exactly is still affected. Just mailing "works for me" or "doesn't work for me" doesn't narrow it down.

Kind regards,

Job

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

-- Michael Adams Tel: +49 221 2222 657 Network Engineering& Design Fax: +49 221 2222 7657 NetCologne Geschäftsführer Gesellschaft für Telekommunikation mbH Dr. Hans Konle (Sprecher) Am Coloneum 9 Dipl.-Ing. Karl-Heinz Zankel 50829 Köln HRB 25580, Amtsgericht Köln -- Michael Adams Tel: +49 221 2222 657 Network Engineering& Design Fax: +49 221 2222 7657 NetCologne Geschäftsführer Gesellschaft für Telekommunikation mbH Dr. Hans Konle (Sprecher) Am Coloneum 9 Dipl.-Ing. Karl-Heinz Zankel 50829 Köln HRB 25580, Amtsgericht Köln

Me too I have the same problem on 78.212.in-addr.arpa. Bye -- Enrico Corneo enrico.corneo@gmail.com Skype aste83 On Thu, Jun 14, 2012 at 10:52 AM, Anders Olausson <anders@spacedump.se> wrote:

Hi,

They have a post on facebook. http://www.ripe.net/internet-coordination/news/announcements/update-regardin...

Doesn't mention 212.in-addr.arpa. though (I have a range in that scope too and I also have the same problem).

Regards  Anders Olausson - SpaceDump IT AB

...

Does anyone get a feedback about the probleb  from Ripe?

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.

Same here, 212.0.0.0/8 is impacted and causing us problems - I'm trying the workaround of editing the database entries that someone else suggested and that seems to work so far. On 14/06/12 09:49, igor.grinevich@vegatele.com wrote:

Hi!

We have the same issue with some reverse zones хх.хх.212.in-addr.arpa. Does anyone get a feedback about the probleb from Ripe?

Regards, Igor Grinevich Vega

-----Original Message----- From: members-discuss-bounces@ripe.net [mailto:members-discuss-bounces@ripe.net] On Behalf Of Raymond Dijkxhoorn Sent: Thursday, June 14, 2012 9:31 AM To: members-discuss-bounces@ripe.net Cc: Jørgen Hovland; members-discuss@ripe.net Subject: Re: [members-discuss] Reverse DNS issue - zone still not working fromripe DNS server

Hi!

...

after the issue the ripe services had today evening, we still have one network whre delegation for reverse is still not working.

Of course this is a nightmare as all mail traffic is affected.

Anyone know a way to contact ripe support outside of office hours ? Jun 14 07:23:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:24:47 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:26:06 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:27:09 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: key for validation 179.212.in-addr.arpa. is marked as invalid because of a previous validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 192.134.0.49 for DS 179.212.in-addr.arpa. while building chain of trust Jun 14 07:38:10 infra20 unbound: [6960:1] info: validation failure <102.162.179.212.in-addr.arpa. PTR IN>: no NSEC3 records from 202.12.28.140 for DS 179.212.in-addr.arpa. while building chain of trust

This still was happening on several zones up to one hour ago. Since this is impacting the real world pretty badly i would expect a bit more fuzz. Mailflows are impacted with this, providers rejecting mails due to missing and/or invalid rdns...

Bye, Raymond.

---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses. ---- If you don't want to receive emails from the RIPE NCC members-discuss mailing list, please log in to your LIR Portal account and go to the general page: https://lirportal.ripe.net/general/view

Click on "Edit my LIR details", under "Subscribed Mailing Lists". From here, you can add or remove addresses.