- db-wg - mailman.ripe.net

Historical data and deleted objects
by Bengt Gördén 28 Nov '13

28 Nov '13

Hi, We had some talk about historical data on RIPE67 and I think we agreed on the possibility of retrieving deleted history too. Is there any progress on this? regards, -- Bengt Gördén Resilans AB

3 3

New minor release 1.70.1 to fix replication issue
by Johan Åhlén 21 Nov '13

21 Nov '13

Dear colleagues, We have identified the cause of the recent replication issues we've been experiencing with the MySQL back-end. In short, we have detected a bug in the particular MySQL version we are currently running. In order to avoid this bug, we had to implement a workaround that we deployed today at 16:30 (UTC +1). Since the workaround was the only feasible solution, we were forced to build and deploy a new minor version (1.70.1) of the RIPE Database software. Release notes can be found here: https://www.ripe.net/data-tools/db/release-notes Kind regards, Johan Åhlén Assistant Manager, Database RIPE NCC

1 0

Problem with replication
by Johan Åhlén 21 Nov '13

21 Nov '13

Dear colleagues, Since 0:00 (UTC+1) on Wednesday, 20 November, we’ve experienced some issues with data replication in our back-end system. This has led to unreasonable delays between executing a database update and seeing the result in the queries in some cases. We want to ensure you that all updates have been processed and no data has been lost. We have a temporary fix to restore data replication to a normal state, so currently the replication is working as it should. However, for unknown reasons, the replication has been failing at some point during the night. We’re working very hard to identify the root cause of this issue in order to find a permanent solution to the problem. Please check the Service and Security Announcements page for updates if you encounter any issues: http://www.ripe.net/lir-services/service-announcements. Kind regards, Johan Åhlén Assistant Manager, Database RIPE NCC

1 0

[training] RIPE NCC Training Courses January-March 2014
by Training Team 18 Nov '13

18 Nov '13

Dear Colleagues, Our training team travels the RIPE NCC service region to deliver training courses to our members without any additional cost. Over the next few months, we'll be in Lisbon, Frankfurt, Busto Arsizio, Manamah, St. Petersburg, Tallinn, London, Warsaw, Copenhagen, Amsterdam, Bucharest. Visit the following page to register and to check which training courses we are giving in your area: https://lirportal.ripe.net/training/courses The RIPE NCC delivers the following training courses: - LIR Training Course - Database Training Course - IPv6 for LIRs Training Course - Routing Security Training Course For more information visit: http://www.ripe.net/lir-services/training/courses With kind regards, Rumy Spratley-Kanis Training Services Manager

1 0

RIPE Database Release 1.70
by Denis Walker 12 Nov '13

12 Nov '13

Dear colleagues, The new release 1.70 of the RIPE Database was deployed to the TEST Database environment on Thursday, 31 October 2013 and is now ready to be deployed to the production database. The deployment will commence at 20:00 (UTC+1) on Thursday, 14 November 2013 and may take up to three hours to complete. During this time, updates will not be available. Any email updates submitted during this period will be queued. Updates by any other means will return an error message. Queries will not be affected during this deployment. The reason for the outage is an operational clean-up that the RIPE NCC has to do occasionally on the RIPE Database. Some long-since deprecated objects and attributes will be removed from the SQL table structure. This clean-up will not cause any visible change to users. The clean-up was done on the TEST Database during the deployment of 1.70 in October. Regards Denis Walker Business Analyst RIPE NCC Database Team

1 0

RIPE Database Release 1.70 Available
by Denis Walker 06 Nov '13

06 Nov '13

Dear colleagues, The RIPE NCC is pleased to announce that we will deploy a new release of the RIPE Database to the TEST Database environment on Thursday, 31 October 2013. The release is scheduled for production deployment on Thursday, 12 November 2013. Detailed information about the new release, including dates and information about the changes, can be found at: https://www.ripe.net/data-tools/db/release-notes/ripe-database-release-1.70 Of special note in this release is the inclusion of "pending route authentication". This is an alternative and simplified way of authorising route object creation. Two separate updates for a single route/route6 object are treated as one create request. This has no impact on users who still submit a complete route object with all authorisations included. If you have any questions or comments, we look forward to hearing them. Regards, Denis Walker Business Analyst RIPE NCC Database Team

1 1

[training] RIPE NCC Webinars - new dates
by Training Team 29 Oct '13

29 Oct '13

Dear colleagues, We are pleased to announce the launch of new dates for our Webinars. The RIPE NCC Webinars are live and take only one hour. You can interact with our trainers without leaving your desk. We focus on the topics and issues most important for LIRs. Register now at https://www.ripe.net/lir-services/training/e-learning/webinars Participation is limited to 20 people, so don't hesitate if you want to take part! If you have questions, please email <training(a)ripe.net>. We look forward to seeing you online. Kind regards, RIPE NCC Training Services

1 0

Support for recursive expansion of as-set to a list of ASNs
by Job Snijders 21 Oct '13

21 Oct '13

Dear DB-WG, Now that the new database backend is in place, this should allow for awesome features such as server sided recursion of AS-SETs into a list of ASNs. Implementing IRRd's !i flag will prevent a lot of back and forth communication between whois server and client to provide the client with a full list of ASNs which are part of an AS-SET. Clients such as bgpq3 support this flag. I've filed an enhancement request on github: https://github.com/RIPE-NCC/whois/issues/72 But we could use this thread to assess community support and gather a sense of priority. Kind regards, Job

3 2

abuse-c + org / inetnum
by Gilles Massen 19 Oct '13

19 Oct '13

Dear WGs, In the light of the upcoming RIPE meeting I'd like to bring the problem of a single entity (organisation) wanting different abuse-c for different resources up again. The discussion starting in June (http://www.ripe.net/ripe/mail/archives/db-wg/2013-June/004079.html ) was rather open ended. Apparently the only workable solution at this point is to create a duplicate organisation object with a different abuse-c. Is data duplication really the solution that the WGs would like? Gilles -- Fondation RESTENA - DNS-LU 6, rue Coudenhove-Kalergi L-1359 Luxembourg tel: (+352) 424409 fax: (+352) 422473

6 6

Route Polict Verification
by Alexander Azimov 17 Oct '13

17 Oct '13

Dear colleagues, During current RIPE meeting I have presented my report about verification of route policy from registries with deeper analysis for RIPE database. I analysed the customer to provider relations because of its global visibility. The result are fearful: 60% of link completeness, less than half of this amount have information about Pref values and again most of pref values have errors. As a result there is only 10% likelihood to find real priorities using this dataset. The community must decide how to change this situation. In my opinion there are only two ways to overcome this problem: verify this data or delete at all. All our data is available on our website <http://radar.qrator.net>. The collected data is based on imitation mathematical model with use of AS paths recovered from BGP views and novel active verification abilities that could detect priorities on every level of BGP decision making process. We are eager for collaboration and eager to help RIPE Stats or RIPE DB to verify policy data, highlight errors and give other aggregated data if community decides that it is needed. -- | Alexander Azimov | HLL l QRATOR | tel.: +7 499 241 81 92 | mob.: +7 915 360 08 86 | skype: mitradir | mailto: aa(a)highloadlab.com | visit: www.qrator.net

4 6

Korrektion: RIPE67 DB-WG Draft Agenda V2
by Wilfried Woeber 16 Oct '13

16 Oct '13

..."of course" I go it wrong, my sincere apologies: [1] for remote participation: this is *08:00 UTC* Oh my, blush, Wilfried

1 0

RIPE67 DB-WG Draft Agenda V2
by Wilfried Woeber 16 Oct '13

16 Oct '13

Dear DB-WG folks, Chairpersons, "Meeting"! This is the 2nd draft of an agenda for the DB-WG Meeting at RIPE67 in Athens, scheduled for October 17, 2013. For time slot allocations please refer to the most up-to-date meeting plan at https://ripe67.ripe.net/programme/meeting-plan/ The DB-WG Meeting is scheduled for *Thursday*, starting at 11:00 local time[1] in the morning. The length of our timeslot is 90 Minutes. The overall (draft) RIPE 67 meeting outline is already available at https://ripe67.ripe.net/programme/meeting-plan/ Changes from V1: - the separate items pertaining to the DataBase are lumped together - a new item on GeoLoc Data Management Please feel free to propose additional topics to be discussed! I'd also suggest that you submit your points of view regarding the topics on the proposed agenda on the mailing list, preferably before the WG meeting's start :-) Best regards, hope to see you soon in Athens, Wilfried. [1] for remote participation: this 09:00 UTC ________________________________________________________________________ A. Administrative Matters . Welcome . select scribe . finalise agenda . approval of minutes from previous WG meeting(s) . review of action list B. Data Base Update (Denis.W., Johan.Å., RIPE NCC) - operational report - software release management and TEST DB - things "in the pipe" - WEIRDS C. UTF-8 transparency in the Registry - functionality and/or restrictions by components - policy or business logic interactions, - coordination /input with/from other WGs D. Common Format for GeoLoc data (Zoltan Sz., Google) Y. Input from other Working Groups and/or Task Forces - review of abuse contact stuff (N.N. t.b.c.)) Z. AOB ________________________________________________________________________ 16.10.2013 11:20 UTC

1 0

[training] RIPE NCC Webinars - new dates
by Training Team 15 Oct '13

15 Oct '13

Dear colleagues, We are pleased to announce the launch of new dates for our Webinars. The RIPE NCC Webinars are live and take only one hour. You can interact with our trainers without leaving your desk. We focus on the topics and issues most important for LIRs. Register now at https://lirportal.ripe.net/training/courses Participation is limited to 20 people, so don't hesitate if you want to take part! If you have questions, please email <training(a)ripe.net>. We look forward to seeing you online. Kind regards, RIPE NCC Training Services

1 0

Improvements to RIPE Database Software Release Management
by Johan Åhlén 10 Oct '13

10 Oct '13

Dear colleagues, Following recent discussion regarding the release management of the RIPE Database software, we looked closely at our procedures and would like to propose some improvements. Together with the Database Working Group chairs, we've scheduled an informal meeting during RIPE 67, open for anyone that is interested in this topic, to discuss the proposals and talk about how we can improve our procedures. The meeting will take place on Monday, 14 October from 18:00-19:00 in room Sigma + Theta. We hope you will join us. Of course, you can also send your feedback and suggestions to this list. This is what we propose: - Split the RIPE Database software into smaller modules. Modularisation would minimise the release frequency for our services. For instance, with a modern API like RDAP we might have bi-weekly major releases and weekly minor releases to quickly respond to changes in the specification. With the NRTM feed, there might be just one major release per year or even less. - Replace the "emergency release" with a "minor release" that only contains patches for operational purposes and bug fixes. No new functionality would be introduced and no feature changes. We would also have "major releases" where functionality is added, changed or removed. With major releases we would keep the minimum two-week user test period leading up to the production release as stated in the previously proposed release procedure. With any minor release, we would put it in production as soon as it's available. Most bugs affect some users. Rather than trying to determine urgency based on numbers of users, size of users, number of networks affected, importance of functionality affected, etc., we would treat all bugs the same. In short, if someone reports an issue to us, we fix it right away. This process has generally worked well over recent years. - Improve the test environment. We know that users would like to have their real data to do proper testing. To solve this issue, we propose to use snapshots of the current database for this purpose. - Improve communication surrounding new releases. This covers all documentation and how we inform users about changes. We hope that you find this way forward beneficial. Kind regards, Johan Åhlén Assistant Manager Database RIPE NCC

2 2

Syntax Change to Aut-num Object in the RIPE Database
by Denis Walker 09 Oct '13

09 Oct '13

Dear colleagues, We would like to give you a heads-up about a proposal, currently being considered, to add two new attributes to the aut-num object in the RIPE Database: "import-via:" and "export-via:". In this email we are not concerned with the details of this specific change so much as the fact that a change is being considered. We know that these objects are very important for routing and many of them are updated daily in the RIPE Database. We also know that many scripts exist for auto-generating these objects and processing the contents. Although the RFC for RPSL clearly states that scripts should be written to ignore attributes they don't recognise, we don't know if all scripts are written this way. The RIPE NCC is considering the best ways to get information about any changes to routing object syntax in the RIPE Database out to the people who need to know. We would welcome any feedback on this issue from the community. Regards, Denis Walker Business Analyst RIPE NCC Database Team

1 0

Re: [db-wg] new "via" attributes in aut-num Class
by Erik Bais 09 Oct '13

09 Oct '13

Hi Job & Johan, I think the implementation makes sense and my compliments on the draft. It looks good: > http://tools.ietf.org/html/draft-snijders-rpsl-via Is this already in the new db version or is this still waiting for more community support ? For me, support +1. Kind regards, Erik Bais A2B Internet > > I have submitted the following draft to the IETF: > > http://tools.ietf.org/html/draft-snijders-rpsl-via > > And I have submitted a patch for the RIPE whois server to support the feature. > > https://github.com/job/whois > > The extension should be backward compatible with minimal impact on existing > tools and processes, following Section 10.2 of RFC2622. RPSL parsers which > do not understand the new attributes are expected to just ignore it. > > I am looking for feedback from this community, and especially the community's > blessing to allow RIPE NCC to adopt the patch. > > Kind regards, > > Job

2 1

DB documentation?
by Gilles Massen 07 Oct '13

07 Oct '13

Hi, Considering that the documentation linked from the RIPE website ( http://www.ripe.net/data-tools/support/documentation/update-ref-manual ) is out of date, is a current database documentation / reference manual available somewhere? Any pointer (short of the database source code) welcome... Gilles -- Fondation RESTENA - DNS-LU 6, rue Coudenhove-Kalergi L-1359 Luxembourg tel: (+352) 424409 fax: (+352) 422473

2 2

RIPE Database Release 1.69 Available Soon
by Denis Walker 01 Oct '13

01 Oct '13

Dear colleagues, The RIPE NCC is pleased to announce that we have deployed a new release of the RIPE Database to the TEST Database environment. Detailed information about the new release, including dates and information about the changes can be found here: https://www.ripe.net/data-tools/db/release-notes/ripe-database-release-1.69 Of special note in this release is the inclusion of "dry-run". Using the dry-run function you can test whether an update would succeed or not. The update procedure runs as normal except that no change is made to the database. Find out more about the dry-run function here: https://labs.ripe.net/Members/denis/dry-run-testing-in-the-ripe-database Due to recent issues with the REST API, we've extended the migration period up until the 1.70 release. This release is currently scheduled for the end of October. If you have any questions or comments, we look forward to hearing them! Regards, Denis Walker Business Analyst RIPE NCC Database Team

5 8

installing "RIPE Whois Database"
by Martin T 01 Oct '13

01 Oct '13

Hi, I would like to install "RIPE Whois Database" locally for testing purposes. I have downloaded the latest release: dbase@A58:~$ wget -q https://github.com/RIPE-NCC/whois/archive/master.zip dbase@A58:~$ unzip -qq master.zip dbase@A58:~$ ..and installed logrotate, sendmail, git, maven, openjdk-7-doc, openjdk-7-jdk, openjdk-7-source, mysql-server and mysql-client packages from Debian Wheezy repository. Mysqld is listening on TCP port 3306 and user dbint is created: mysql> SELECT * FROM mysql.user WHERE User = 'dbint' ; +-----------+-------+----------+-------------+-------------+-------------+-------------+-------------+-----------+-------------+---------------+--------------+-----------+------------+-----------------+------------+------------+--------------+------------+-----------------------+------------------+--------------+-----------------+------------------+------------------+----------------+---------------------+--------------------+------------------+------------+--------------+------------------------+----------+------------+-------------+--------------+---------------+-------------+-----------------+----------------------+--------+-----------------------+ | Host | User | Password | Select_priv | Insert_priv | Update_priv | Delete_priv | Create_priv | Drop_priv | Reload_priv | Shutdown_priv | Process_priv | File_priv | Grant_priv | References_priv | Index_priv | Alter_priv | Show_db_priv | Super_priv | Create_tmp_table_priv | Lock_tables_priv | Execute_priv | Repl_slave_priv | Repl_client_priv | Create_view_priv | Show_view_priv | Create_routine_priv | Alter_routine_priv | Create_user_priv | Event_priv | Trigger_priv | Create_tablespace_priv | ssl_type | ssl_cipher | x509_issuer | x509_subject | max_questions | max_updates | max_connections | max_user_connections | plugin | authentication_string | +-----------+-------+----------+-------------+-------------+-------------+-------------+-------------+-----------+-------------+---------------+--------------+-----------+------------+-----------------+------------+------------+--------------+------------+-----------------------+------------------+--------------+-----------------+------------------+------------------+----------------+---------------------+--------------------+------------------+------------+--------------+------------------------+----------+------------+-------------+--------------+---------------+-------------+-----------------+----------------------+--------+-----------------------+ | localhost | dbint | | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | | | | | 0 | 0 | 0 | 0 | | NULL | +-----------+-------+----------+-------------+-------------+-------------+-------------+-------------+-----------+-------------+---------------+--------------+-----------+------------+-----------------+------------+------------+--------------+------------+-----------------------+------------------+--------------+-----------------+------------------+------------------+----------------+---------------------+--------------------+------------------+------------+--------------+------------------------+----------+------------+-------------+--------------+---------------+-------------+-----------------+----------------------+--------+-----------------------+ 1 row in set (0.00 sec) mysql> As I understand, now I need whois.jar file which is an archive containing Java class files? Where can I get this? regards Martin

2 3

training] RIPE NCC Webinars - new dates
by Training Team 24 Sep '13

24 Sep '13

Dear colleagues, We are pleased to announce the launch of new dates for our Webinars. The RIPE NCC Webinars are live and take only one hour. You can interact with our trainers without leaving your desk. We focus on the topics and issues most important for LIRs. Register now at https://lirportal.ripe.net/training/courses Participation is limited to 20 people, so don't hesitate if you want to take part! If you have questions, please email <training(a)ripe.net>. We look forward to seeing you online. Kind regards, RIPE NCC Training Services

1 1

Re: [db-wg] new "via" attributes in aut-num Class
by David Freedman 22 Sep '13

22 Sep '13

>http://tools.ietf.org/html/draft-snijders-rpsl-via Having read the draft, this seems sensible and seems to have a strong use case. >If the community supports the addition of the proposed attributes the >RIPE NCC can go ahead and merge his implementation and make it available >in the next release Yes, I'd like to see an implementation please. Dave.

1 0

RIPE67 DB-WG Draft Agenda V1
by Wilfried Woeber 08 Sep '13

08 Sep '13

Dear DB-WG folks, Chairpersons, "Meeting"! This is the 1st draft of an agenda for the DB-WG Meeting at RIPE67 in Athens, scheduled for October 17, 2013. For time slot allocations please refer to the most up-to-date meeting plan at https://ripe67.ripe.net/programme/meeting-plan/ The DB-WG Meeting is scheduled for *Thursday*, starting at 11:00 local time[1] in the morning. The length of our timeslot is 90 Minutes. The overall (draft) RIPE 67 meeting outline is already available at https://ripe67.ripe.net/programme/meeting-plan/ Please feel free to propose additional topics to be discussed! I'd also suggest that you submit your points of view regarding the topics on the proposed agenda on the mailing list, preferably before the WG meeting's start :-) Best regards, hope to see you soon in Athens, Wilfried. [1] for remote participation, we'll come back later with the UTC information ________________________________________________________________________ A. Administrative Matters . Welcome . select scribe . finalise agenda . approval of minutes from previous WG meeting(s) . review of action list B. Data Base Operational Update (N.N., RIPE NCC) C. New DB-Software functionality - in beta - proposed D. Dicussion / Report regarding management of Software Releases - formal procedure for announcments and deployment - functionality / importance of TEST DB environment - report and/or discussion of Workshop/BoF-Results (t.b.c.) E. UTF-8 transparency in the Registry - functionality and/or restrictions by components - policy or business logic interactions, - coordination /input ith/from other WGs F. Status update on IETF WEIRDS activities (N.N. t.b.c.) Y. Input from other Working Groups and/or Task Forces - review of abuse contact stuff (N.N. t.b.c.)) Z. AOB ________________________________________________________________________ 08.09.2013 12:30 UTC

1 0

Call for agenda items, DB-WG Meeting during RIPE67, Athens, GR
by Wilfried Woeber 04 Sep '13

04 Sep '13

Dear DB-WG folks, planning activities for the next RIPE Meeting - RIPE67 in Athens, GR, Oct. 14 - Oct. 18, 2013, have already started a while ago - thus this _call for agenda items_ for the meeting of the Database Working-Group. Please submit (to the WG list!) your item requests and|or suggest topics for discussion to be included in the draft agenda! Please note that the DataBase-WG meeting is *at the moment* scheduled for *Thursday* (starting at 11:00 local time). This is according to the *draft* meeting plan - which is pretty stable already but may still need to be changed as we get closer to the meeting date! The overall (draft) RIPE 66 meeting outline is already available at https://ripe67.ripe.net/programme/meeting-plan/ Looking forward to a successful meeting and see you soon in Greece! Wilfried.

1 0

New bug fix release scheduled for 29 August
by Johan Åhlén 29 Aug '13

29 Aug '13

Dear colleagues, We have moved documentation for the RIPE Database WHOIS REST API out of the database software. It can be accessed at: https://github.com/RIPE-NCC/whois/wiki/WHOIS-REST-API Given the benefits associated with generated documentation, we intend to look for another solution for this at a later stage. Since the last release there have been a number of issues reported regarding the REST API. As this is particularly important for users migrating from the old REST service to the new one, we have now addressed these issues in a bug fix release that we will put in production this week, ahead of the next major RIPE Database release. The issues addressed by this release are listed here: https://github.com/RIPE-NCC/whois/issues?milestone=1&state=closed For users migrating from the old REST API, we have also created a migration guide that can be found at: https://github.com/RIPE-NCC/whois/wiki/WHOIS-REST-API-Migration-Guide The bug fix release is now available in TEST Database and we intend to upgrade the production database on Thursday evening, 29 August. Kind regards, Johan Åhlén Assistant Manager Database RIPE NCC

3 2

Update on today's bug fix release
by Johan Åhlén 29 Aug '13

29 Aug '13

Dear colleagues, Since announcing the next bug fix release for the RIPE Database, we have received some important feedback from the community. Based on some discussions off-list on how to proceed we have decided to move forward and put the release into production today. The current production version of the REST API was not working as intended, and while investigating issues with the broken documentation, other issues were identified, that if not fixed, would lead to unintended use of the REST API. We believe that since this is now affecting certain RIPE Database users, we should not delay deployment any more than necessary. We realise this may not be the most satisfactory deployment and we assure you that the matter will be further considered and discussed at RIPE 67. If you can't be there and have some views on this matter we would very much appreciate hearing from you on the mailing list. Kind regards, Johan Åhlén Assistant Manager Database RIPE NCC

1 0