Hello, I hope you are all doing well. I have a few questions concerning the measurements selection, and I am interested only on the anchoring mesh measurements. In fact, for optimisation issues, I would like to be able to select only measurements of interest: For example, I want to get the results coming from sources: X and Y, and targeting the anchor 6771. Now I can get the measures targeting the anchor 6771 using this code from Altas Cousteau ################################################################## from ripe.atlas.cousteau import MeasurementRequest filters = {'tags': ['anchoring','mesh',6771] } measurements = MeasurementRequest(**filters) #################################################################### But I have no idea of how to make a filter on the sources as well, since all we can access through the measurements are the number of anchors requested and not their ids. Do you know a way to get access to the sources of a measurement via Atlas Cousteau or another Ripe Tool ? Thank you -- Sanaa
On Thu, Apr 22, 2021 at 02:01:04PM +0200, Sanaa GHANDI <sanaa.ghandi@imt-atlantique.fr> wrote a message of 30 lines which said:
But I have no idea of how to make a filter on the sources as well, since all we can access through the measurements are the number of anchors requested and not their ids.
Do you know a way to get access to the sources of a measurement via Atlas Cousteau or another Ripe Tool ?
I'm afraid you'll have to download the raw JSON file <https://ftp.ripe.net/ripe/atlas/measurements/>, parse it yourself and filter according to the "probes" array.
On Thu, Apr 22, 2021 at 02:20:20PM +0200, Stephane Bortzmeyer <bortzmeyer@nic.fr> wrote a message of 15 lines which said:
I'm afraid you'll have to download the raw JSON file <https://ftp.ripe.net/ripe/atlas/measurements/>, parse it yourself and filter according to the "probes" array.
The small Python program attached gives an example. % ./read.py meta-20210421.txt 50005 ... Measurement 29755186 uses the probe 50005 Measurement 29755187 uses the probe 50005 Measurement 29755701 uses the probe 50005 Measurement 29755702 uses the probe 50005 Measurement 29755704 uses the probe 50005 Measurement 29756177 uses the probe 50005 Measurement 29756178 uses the probe 50005 ...
Hi, On 22/04/2021 14:01, Sanaa GHANDI wrote:
For example, I want to get the results coming from sources: X and Y, and targeting the anchor 6771.
This kind of query can be where the public bigquery datasets are useful, because bigquery will let you walk through the result data directly. (Some details and pre-requisites are at [1,2]). Something as simple as this query would be a good start for the question above:
select distinct msm_id from `ripencc-atlas`.yesterday.traceroute where (prb_id = X or prb_id = Y) and (af = 4 and dst_addr = "91.201.7.243")
Note we're expanding the available public datasets a bit from what's currently in the docs: * "yesterday" is a dataset that refers to measurements collected yesterday * "24hours" is a dataset referring to the most recent 24 hours * "samples" is a truly tiny dataset for prototyping and is great for getting started * "measurements" is most data reaching 18+ months back, and where you should definitely use a date filter in the query :-) Depending on what you're trying to get out of the data, the above might be enough to get you started. Feel free to throw general questions here, or technical questions to atlas-bq@ripe.net Cheers, S. [1] https://github.com/RIPE-NCC/ripe-atlas-bigquery [2] https://github.com/RIPE-NCC/ripe-atlas-bigquery/blob/main/docs/gettingstarte...
Now I can get the measures targeting the anchor 6771 using this code from Altas Cousteau
################################################################## from ripe.atlas.cousteau import MeasurementRequest
filters = {'tags': ['anchoring','mesh',6771] }
measurements = MeasurementRequest(**filters) ####################################################################
But I have no idea of how to make a filter on the sources as well, since all we can access through the measurements are the number of anchors requested and not their ids.
Do you know a way to get access to the sources of a measurement via Atlas Cousteau or another Ripe Tool ?
Thank you
-- Sanaa
Hi, On 22/04/2021 14:01, Sanaa GHANDI wrote:
Hello,
I hope you are all doing well.
I have a few questions concerning the measurements selection, and I am interested only on the anchoring mesh measurements.
In fact, for optimisation issues, I would like to be able to select only measurements of interest:
For example, I want to get the results coming from sources: X and Y, and targeting the anchor 6771.
Now I can get the measures targeting the anchor 6771 using this code from Altas Cousteau
################################################################## from ripe.atlas.cousteau import MeasurementRequest
filters = {'tags': ['anchoring','mesh',6771] }
measurements = MeasurementRequest(**filters) ####################################################################
But I have no idea of how to make a filter on the sources as well, since all we can access through the measurements are the number of anchors requested and not their ids.
Do you know a way to get access to the sources of a measurement via Atlas Cousteau or another Ripe Tool ?
You cannot filter directly on the probes but you can include the list of probes participating in the measurement: https://atlas.ripe.net/api/v2/measurements/29786041/?optional_fields=probes <https://atlas.ripe.net/api/v2/measurements/29786041/?optional_fields=probes> You can then iterate over this key to find if the probes you're looking for are included and get only those results with something like this: https://atlas.ripe.net/api/v2/measurements/29786041/results/?probe_ids=6945 <https://atlas.ripe.net/api/v2/measurements/29786041/results/?probe_ids=6945> Hope this helps, Cheers, Johan
Thank you
-- Sanaa
participants (4)
-
Johan ter Beest -
Sanaa GHANDI -
Stephane Bortzmeyer -
Stephen Strowes