derek/gem5
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

stdlib, tests, configs: Introduce gem5 Vision to resources

Browse Source 
This patch makes changes to the stdlib based on the gem5 Vision project.
Firstly, a MongoDB database is supported.
A JSON database's support is continued.
The JSON can either be a local path or a raw GitHub link.

The data for these databases is stored in src/python
under "gem5-config.json".
This will be used by default.
However, the configuration can be overridden:
- by providing a path using the GEM5_CONFIG env variable.
- by placing a gem5-config.json file in the current working directory.

An AbstractClient is an abstract class that implements
searching and sorting relevant to the databases.

Clients is an optional list that can be passed
while defining any Resource class and obtain_resource.
These databases can be defined in the config JSON.

Resources now have versions. This allows for a
single version, e.g., 'x86-ubuntu-boot', to have
multiple versions. As such, the key of a resource is
its ID and Version (e.g., 'x86-ubuntu-boot/v2.1.0').
Different versions of a resource might be compatible
with different versions of gem5.

By default, it picks the latest version compatible with the gem5 Version
of the user.

A gem5 resource schema now has additional fields.
These are:
- source_url: Stores URL of GitHub Source of the resource.
- license: License information of the resource.
- tags: Words to identify a resource better, like hello for hello-world
- example_usage: How to use the resource in a simulation.
- gem5_versions: List of gem5 versions that resource is compatible with.
- resource_version: The version of the resource itself.
- size: The download size of the resource, if it exists.
- code_examples: List of objects.
These objects contain the path to where a resource is
used in gem5 example config scripts,
and if the resource itself is used in tests or not.
- category: Category of the resource, as defined by classes in
src/python/gem5/resources/resource.py.

Some fields have been renamed:
- "name" is changed to "id"
- "documentation" is changed to "description"

Besides these, the schema also supports resource specialization.
It adds fields relevant to a specific resource as specified in
src/python/gem5/resources/resource.py
These changes have been made to better present
information on the new gem5 Resources website.

But, they do not affect the way resources are used by a gem5 user.
This patch is also backwards compatible.
Existing code doesn't break with this new infrastructure.

Also, refs in the tests have been changed to match this new schema.
Tests have been changed to work with the two clients.

Change-Id: Ia9bf47f7900763827fd5e873bcd663cc3ecdba40
Co-authored-by: Kunal Pai <kunpai@ucdavis.edu>
Co-authored-by: Parth Shah <helloparthshah@gmail.com>
Co-authored-by: Harshil Patel <harshilp2107@gmail.com>
Co-authored-by: aarsli <arsli@ucdavis.edu>
Reviewed-on: https://gem5-review.googlesource.com/c/public/gem5/+/70858
Tested-by: kokoro <noreply+kokoro@google.com>
Maintainer: Jason Lowe-Power <power.jg@gmail.com>
Reviewed-by: Jason Lowe-Power <power.jg@gmail.com>
This commit is contained in:
Kunal Pai
2023-05-21 23:35:40 -07:00
committed by Kunal Pai
parent b355baac93
commit ffbf73db1d
26 changed files with 2413 additions and 342 deletions
Download Patch File Download Diff File Expand all files Collapse all files

511
tests/pyunit/stdlib/resources/pyunit_client_wrapper_checks.py Normal file
View File

@@ -0,0 +1,511 @@
# Copyright (c) 2023 The Regents of the University of California
# All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions are
# met: redistributions of source code must retain the above copyright
# notice, this list of conditions and the following disclaimer;
# redistributions in binary form must reproduce the above copyright
# notice, this list of conditions and the following disclaimer in the
# documentation and/or other materials provided with the distribution;
# neither the name of the copyright holders nor the names of its
# contributors may be used to endorse or promote products derived from
# this software without specific prior written permission.
#
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
import unittest
from gem5.isas import ISA
from gem5.resources.client import get_resource_json_obj
import gem5.resources.client
from gem5.resources.client_api.client_wrapper import ClientWrapper
from typing import Dict
from unittest.mock import patch
from unittest import mock
import json
from urllib.error import HTTPError
import io
import contextlib
from pathlib import Path
mock_json_path = Path(__file__).parent / "refs/resources.json"
mock_config_json = {
"sources": {
"baba": {
"url": mock_json_path,
"isMongo": False,
}
},
}
mock_config_mongo = {
"sources": {
"gem5-resources": {
"dataSource": "gem5-vision",
"database": "gem5-vision",
"collection": "versions_test",
"url": "https://data.mongodb-api.com/app/data-ejhjf/endpoint/data/v1",
"authUrl": "https://realm.mongodb.com/api/client/v2.0/app/data-ejhjf/auth/providers/api-key/login",
"apiKey": "OIi5bAP7xxIGK782t8ZoiD2BkBGEzMdX3upChf9zdCxHSnMoiTnjI22Yw5kOSgy9",
"isMongo": True,
}
},
}
mock_config_combined = {
"sources": {
"gem5-resources": {
"dataSource": "gem5-vision",
"database": "gem5-vision",
"collection": "versions_test",
"url": "https://data.mongodb-api.com/app/data-ejhjf/endpoint/data/v1",
"authUrl": "https://realm.mongodb.com/api/client/v2.0/app/data-ejhjf/auth/providers/api-key/login",
"apiKey": "OIi5bAP7xxIGK782t8ZoiD2BkBGEzMdX3upChf9zdCxHSnMoiTnjI22Yw5kOSgy9",
"isMongo": True,
},
"baba": {
"url": mock_json_path,
"isMongo": False,
},
},
}
mock_json = {}
with open(Path(__file__).parent / "refs/mongo_mock.json", "r") as f:
mock_json = json.load(f)
duplicate_mock_json = {}
with open(Path(__file__).parent / "refs/mongo_dup_mock.json", "r") as f:
duplicate_mock_json = json.load(f)
def mocked_requests_post(*args):
# mokcing urllib.request.urlopen
class MockResponse:
def __init__(self, json_data, status_code):
self.json_data = json_data
self.status = status_code
def read(self):
return json.dumps(self.json_data).encode("utf-8")
data = json.loads(args[0].data)
if "/api-key/login" in args[0].full_url:
return MockResponse({"access_token": "test-token"}, 200)
if "/endpoint/data/v1/action/find" in args[0].full_url:
if data:
if data["filter"]["id"] == "x86-ubuntu-18.04-img":
return MockResponse(
{
"documents": mock_json,
},
200,
)
if data["filter"]["id"] == "test-duplicate":
return MockResponse(
{
"documents": duplicate_mock_json,
},
200,
)
if data["filter"]["id"] == "test-too-many":
error_file = io.BytesIO()
error_file.status = 429
raise HTTPError(
args[0].full_url, 429, "Too Many Requests", {}, error_file
)
return MockResponse(
{
"documents": [],
},
200,
)
error_file = io.BytesIO()
error_file.status = 404
raise HTTPError(args[0].full_url, 404, "Not Found", {}, error_file)
class ClientWrapperTestSuite(unittest.TestCase):
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_json),
)
def test_get_resource_json_obj(self):
# Test that the resource object is correctly returned
resource = "this-is-a-test-resource"
resource = get_resource_json_obj(resource)
self.assertEqual(resource["id"], "this-is-a-test-resource")
self.assertEqual(resource["resource_version"], "2.0.0")
self.assertEqual(resource["category"], "binary")
self.assertEqual(
resource["description"], "This is a test resource but double newer"
)
self.assertEqual(
resource["source_url"],
"https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
)
self.assertEqual(resource["architecture"], "X86")
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_json),
)
def test_get_resource_json_obj_invalid_client(self):
# Test that an exception is raised when an invalid client is passed
resource_id = "test-id"
client = "invalid"
with self.assertRaises(Exception) as context:
get_resource_json_obj(resource_id, clients=[client])
self.assertTrue(
f"Client: {client} does not exist" in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_json),
)
def test_get_resource_json_obj_with_version(self):
# Test that the resource object is correctly returned
resource_id = "this-is-a-test-resource"
resource_version = "1.0.0"
resource = get_resource_json_obj(
resource_id, resource_version=resource_version
)
self.assertEqual(resource["id"], "this-is-a-test-resource")
self.assertEqual(resource["resource_version"], "1.0.0")
self.assertEqual(resource["category"], "binary")
self.assertEqual(resource["description"], "This is a test resource")
self.assertEqual(
resource["source_url"],
"https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
)
self.assertEqual(resource["architecture"], "X86")
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_mongo),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_obj_1(self, mock_get):
resource = "x86-ubuntu-18.04-img"
resource = get_resource_json_obj(resource)
self.assertEqual(resource["id"], "x86-ubuntu-18.04-img")
self.assertEqual(resource["resource_version"], "1.1.0")
self.assertEqual(resource["category"], "disk-image")
self.assertEqual(
resource["description"],
"A disk image containing Ubuntu 18.04 for x86. This image will run an `m5 readfile` instruction after booting. If no script file is specified an `m5 exit` instruction will be executed.",
)
self.assertEqual(
resource["source_url"],
"https://github.com/gem5/gem5-resources/tree/develop/src/x86-ubuntu",
)
self.assertEqual(resource["architecture"], "X86")
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_mongo),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_obj_with_version_mongodb(self, mock_get):
# Test that the resource object is correctly returned
resource_id = "x86-ubuntu-18.04-img"
resource_version = "1.0.0"
resource = get_resource_json_obj(
resource_id,
resource_version=resource_version,
clients=["gem5-resources"],
)
self.assertEqual(resource["id"], "x86-ubuntu-18.04-img")
self.assertEqual(resource["resource_version"], "1.0.0")
self.assertEqual(resource["category"], "disk-image")
self.assertEqual(resource["description"], "This is a test resource")
self.assertEqual(
resource["source_url"],
"https://github.com/gem5/gem5-resources/tree/develop/src/x86-ubuntu",
)
self.assertEqual(resource["architecture"], "X86")
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_mongo),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_obj_with_id_invalid_mongodb(self, mock_get):
resource_id = "invalid-id"
with self.assertRaises(Exception) as context:
get_resource_json_obj(resource_id, clients=["gem5-resources"])
self.assertTrue(
"Resource with ID 'invalid-id' not found."
in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_mongo),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_obj_with_version_invalid_mongodb(
self, mock_get
):
resource_id = "x86-ubuntu-18.04-img"
resource_version = "2.5.0"
with self.assertRaises(Exception) as context:
get_resource_json_obj(
resource_id,
resource_version=resource_version,
clients=["gem5-resources"],
)
self.assertTrue(
f"Resource x86-ubuntu-18.04-img with version '2.5.0'"
" not found.\nResource versions can be found at: "
f"https://resources.gem5.org/resources/x86-ubuntu-18.04-img/versions"
in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_json),
)
def test_get_resource_json_obj_with_version_invalid_json(self):
resource_id = "this-is-a-test-resource"
resource_version = "2.5.0"
with self.assertRaises(Exception) as context:
get_resource_json_obj(
resource_id,
resource_version=resource_version,
)
self.assertTrue(
f"Resource this-is-a-test-resource with version '2.5.0'"
" not found.\nResource versions can be found at: "
f"https://resources.gem5.org/resources/this-is-a-test-resource/versions"
in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_combined),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_obj_combine(self, mock_get):
resource_id_mongo = "x86-ubuntu-18.04-img"
resource_version_mongo = "1.0.0"
resource_id_json = "this-is-a-test-resource"
resource_version_json = "1.0.0"
resource_mongo = get_resource_json_obj(
resource_id_mongo,
resource_version=resource_version_mongo,
clients=["gem5-resources"],
)
resource_json = get_resource_json_obj(
resource_id_json,
resource_version=resource_version_json,
clients=["baba"],
)
self.assertEqual(resource_mongo["id"], "x86-ubuntu-18.04-img")
self.assertEqual(resource_mongo["resource_version"], "1.0.0")
self.assertEqual(resource_mongo["category"], "disk-image")
self.assertEqual(
resource_mongo["description"], "This is a test resource"
)
self.assertEqual(
resource_mongo["source_url"],
"https://github.com/gem5/gem5-resources/tree/develop/src/x86-ubuntu",
)
self.assertEqual(resource_mongo["architecture"], "X86")
self.assertEqual(resource_json["id"], "this-is-a-test-resource")
self.assertEqual(resource_json["resource_version"], "1.0.0")
self.assertEqual(resource_json["category"], "binary")
self.assertEqual(
resource_json["description"], "This is a test resource"
)
self.assertEqual(
resource_json["source_url"],
"https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
)
self.assertEqual(resource_json["architecture"], "X86")
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_combined),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_obj_multi_database_second_only(self, mock_get):
resource_id = "simpoint-resource"
resource = get_resource_json_obj(
resource_id,
)
self.assertEqual(resource["id"], resource_id)
self.assertEqual(resource["resource_version"], "0.2.0")
self.assertEqual(resource["category"], "file")
self.assertEqual(
resource["description"],
(
"Simpoints for running the 'x86-print-this' resource with"
' the parameters `"print this" 15000`. This is encapsulated'
" in the 'x86-print-this-15000-with-simpoints' workload."
),
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_combined),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_json_same_resource_different_versions(
self, mock_get
):
resource_id = "x86-ubuntu-18.04-img"
resource_json = get_resource_json_obj(
resource_id,
)
self.assertEqual(resource_json["id"], "x86-ubuntu-18.04-img")
self.assertEqual(resource_json["resource_version"], "2.0.0")
self.assertEqual(resource_json["category"], "disk-image")
resource_json = get_resource_json_obj(
resource_id,
resource_version="1.0.0",
)
self.assertEqual(resource_json["id"], "x86-ubuntu-18.04-img")
self.assertEqual(resource_json["resource_version"], "1.0.0")
self.assertEqual(resource_json["category"], "disk-image")
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_combined),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_get_resource_same_resource_same_version(self, mock_get):
resource_id = "test-duplicate"
with self.assertRaises(Exception) as context:
get_resource_json_obj(
resource_id,
)
self.assertTrue(
f"Resource {resource_id} has multiple resources with"
f" the same version: 0.2.0" in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(
{
"sources": {
"gem5-resources": {
"dataSource": "gem5-vision",
"database": "gem5-vision",
"collection": "versions_test",
"url": "https://data.mongodb-api.com/app/data-ejhjf/endpoint/data/v1",
"authUrl": "https://realm.mongodb.com/api/client/v2.0/app/data-ejhjf/auth/providers/api-key/logi",
"apiKey": "OIi5bAP7xxIGK782t8ZoiD2BkBGEzMdX3upChf9zdCxHSnMoiTnjI22Yw5kOSgy9",
"isMongo": True,
}
},
}
),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_invalid_auth_url(self, mock_get):
resource_id = "test-resource"
f = io.StringIO()
with self.assertRaises(Exception) as context:
with contextlib.redirect_stderr(f):
get_resource_json_obj(
resource_id,
)
self.assertTrue(
"Error getting resources from client gem5-resources:"
" Panic: Not found" in str(f.getvalue())
)
self.assertTrue(
"Resource with ID 'test-resource' not found."
in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(
{
"sources": {
"gem5-resources": {
"dataSource": "gem5-vision",
"database": "gem5-vision",
"collection": "versions_test",
"url": "https://data.mongodb-api.com/app/data-ejhjf/endpoint/data/v",
"authUrl": "https://realm.mongodb.com/api/client/v2.0/app/data-ejhjf/auth/providers/api-key/login",
"apiKey": "OIi5bAP7xxIGK782t8ZoiD2BkBGEzMdX3upChf9zdCxHSnMoiTnjI22Yw5kOSgy9",
"isMongo": True,
}
},
}
),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_invalid_url(self, mock_get):
resource_id = "test-resource"
f = io.StringIO()
with self.assertRaises(Exception) as context:
with contextlib.redirect_stderr(f):
get_resource_json_obj(
resource_id,
)
self.assertTrue(
"Error getting resources from client gem5-resources:"
" Panic: Not found" in str(f.getvalue())
)
self.assertTrue(
"Resource with ID 'test-resource' not found."
in str(context.exception)
)
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(
{
"sources": {
"gem5-resources": {
"dataSource": "gem5-vision",
"database": "gem5-vision",
"collection": "versions_test",
"url": "https://data.mongodb-api.com/app/data-ejhjf/endpoint/data/v1",
"authUrl": "https://realm.mongodb.com/api/client/v2.0/app/data-ejhjf/auth/providers/api-key/login",
"apiKey": "OIi5bAP7xxIGK782t8ZoiD2BkBGEzMdX3upChf9zdCxHSnMoiTnjI22Yw5kOSgy9",
"isMongo": True,
}
},
}
),
)
@patch("urllib.request.urlopen", side_effect=mocked_requests_post)
def test_invalid_url(self, mock_get):
resource_id = "test-too-many"
f = io.StringIO()
with self.assertRaises(Exception) as context:
with contextlib.redirect_stderr(f):
get_resource_json_obj(
resource_id,
)
self.assertTrue(
"Error getting resources from client gem5-resources:"
" Panic: Too many requests" in str(f.getvalue())
)
self.assertTrue(
"Resource with ID 'test-too-many' not found."
in str(context.exception)
)

155
tests/pyunit/stdlib/resources/pyunit_downloader_checks.py
View File

@@ -1,4 +1,4 @@
# Copyright (c) 2022 The Regents of the University of California
# Copyright (c) 2023 The Regents of the University of California
# All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
@@ -28,6 +28,7 @@ import unittest
import tempfile
import os
from typing import Dict
import json
from gem5.resources.downloader import (
_get_resources_json_at_path,
@@ -42,48 +43,102 @@ class ResourceDownloaderTestSuite(unittest.TestCase):
@classmethod
def setUpClass(cls) -> str:
"""
This creates a simple resource.json temp file for testing purposes.
This creates a simple resources collection for testing
"""
file_contents = (
"{"
+ f'"version" : "{_resources_json_version_required()}",'
+ """
"url_base" : "http://dist.gem5.org/dist/v21-2",
"previous-versions" : {},
"resources": [
{
"type": "resource",
"name" : "riscv-disk-img",
"documentation" : "A simple RISCV disk image based on busybox.",
"architecture": "RISCV",
"is_zipped" : true,
"md5sum" : "d6126db9f6bed7774518ae25aa35f153",
"url": "{url_base}/images/riscv/busybox/riscv-disk.img.gz",
"source" : "src/riscv-fs",
"additional_metadata" : {
"root_partition": null
}
},
{
"type": "resource",
"name" : "riscv-lupio-busybox-img",
"documentation" : "A RISCV disk image, based on busybox, to ...",
"architecture": "RISCV",
"is_zipped" : true,
"md5sum" : "e5bee8a31f45f4803f87c0d781553ccc",
"url": "{url_base}/images/riscv/busybox/riscv-lupio-busybox.img",
"source" : "src/lupv",
"additional_metadata" : {
"root_partition": "1"
}
}
]
}
"""
)
file_contents = [
{
"category": "binary",
"id": "this-is-a-test-resource",
"description": "This is a test resource",
"architecture": "X86",
"size": 13816,
"tags": ["asmtest", "testing", "riscv", "testing"],
"is_zipped": False,
"md5sum": "4e70a98b6976969deffff91eed17fba1",
"source": "src/asmtest",
"url": "http://dist.gem5.org/dist/develop/test-progs/asmtest/bin/rv64mi-p-sbreak",
"code_examples": [],
"license": " BSD-3-Clause",
"author": [],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
"resource_version": "1.0.0",
"gem5_versions": ["23.0"],
"example_usage": 'get_resource(resource_name="rv64mi-p-sbreak")',
},
{
"category": "binary",
"id": "this-is-a-test-resource",
"description": "This is a test resource but double newer",
"architecture": "X86",
"size": 13816,
"tags": ["asmtest"],
"is_zipped": False,
"md5sum": "4e70a98b6976969deffff91eed17fba1",
"source": "src/asmtest",
"url": "http://dist.gem5.org/dist/develop/test-progs/asmtest/bin/rv64mi-p-sbreak",
"code_examples": [],
"license": " BSD-3-Clause",
"author": [],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
"resource_version": "2.0.0",
"gem5_versions": ["23.1"],
"example_usage": 'get_resource(resource_name="rv64mi-p-sbreak")',
},
{
"category": "simpoint",
"id": "test-version",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": False,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": True,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "1.0.0",
"gem5_versions": ["23.0"],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": 'get_resource(resource_name="x86-print-this-1500-simpoints")',
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint",
],
},
{
"category": "file",
"id": "test-version",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": False,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": True,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": ["23.0"],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": 'get_resource(resource_name="x86-print-this-1500-simpoints")',
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint",
],
},
]
file = tempfile.NamedTemporaryFile(mode="w", delete=False)
file.write(file_contents)
file.write(json.dumps(file_contents))
file.close()
cls.file_path = file.name
@@ -100,14 +155,16 @@ class ResourceDownloaderTestSuite(unittest.TestCase):
"create_temp_resources_json" has been loaded correctly into a Python
dictionary.
"""
self.assertTrue("resources" in json)
self.assertEquals(2, len(json["resources"]))
self.assertTrue("name" in json["resources"][0])
self.assertEquals("riscv-disk-img", json["resources"][0]["name"])
self.assertTrue("name" in json["resources"][1])
self.assertEquals(
"riscv-lupio-busybox-img", json["resources"][1]["name"]
)
self.assertEquals(4, len(json))
self.assertTrue("id" in json[0])
self.assertEquals("this-is-a-test-resource", json[0]["id"])
self.assertEquals("binary", json[0]["category"])
self.assertTrue("id" in json[1])
self.assertEquals("this-is-a-test-resource", json[1]["id"])
self.assertTrue("id" in json[2])
self.assertEquals("test-version", json[2]["id"])
self.assertTrue("id" in json[3])
self.assertEquals("test-version", json[3]["id"])
def test_get_resources_json_at_path(self) -> None:
# Tests the gem5.resources.downloader._get_resources_json_at_path()

192
tests/pyunit/stdlib/resources/pyunit_obtain_resources_check.py Normal file
View File

@@ -0,0 +1,192 @@
# Copyright (c) 2023 The Regents of the University of California
# All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions are
# met: redistributions of source code must retain the above copyright
# notice, this list of conditions and the following disclaimer;
# redistributions in binary form must reproduce the above copyright
# notice, this list of conditions and the following disclaimer in the
# documentation and/or other materials provided with the distribution;
# neither the name of the copyright holders nor the names of its
# contributors may be used to endorse or promote products derived from
# this software without specific prior written permission.
#
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
import unittest
import os
import io
import contextlib
from pathlib import Path
from gem5.resources.resource import *
from gem5.resources.looppoint import (
LooppointCsvLoader,
LooppointJsonLoader,
)
from gem5.isas import ISA
from _m5 import core
from gem5.resources.client_api.client_wrapper import ClientWrapper
from unittest.mock import patch
mock_json_path = Path(__file__).parent / "refs/obtain-resource.json"
mock_config_json = {
"sources": {
"baba": {
"url": mock_json_path,
"isMongo": False,
}
},
}
@patch(
"gem5.resources.client.clientwrapper",
new=ClientWrapper(mock_config_json),
)
class TestObtainResourcesCheck(unittest.TestCase):
@classmethod
def setUpClass(cls):
"""Prior to running the suite we set the resource directory to
"ref/resource-specialization.json"
"""
os.environ["GEM5_RESOURCE_JSON"] = os.path.join(
os.path.realpath(os.path.dirname(__file__)),
"refs",
"obtain-resource.json",
)
@classmethod
def tearDownClass(cls) -> None:
"""After running the suite we unset the gem5-resource JSON file, as to
not interfere with others tests.
"""
del os.environ["GEM5_RESOURCE_JSON"]
def get_resource_dir(cls) -> str:
"""To ensure the resources are cached to the same directory as all
other tests, this function returns the location of the testing
directories "resources" directory.
"""
return os.path.join(
os.path.realpath(os.path.dirname(__file__)),
os.pardir,
os.pardir,
os.pardir,
"gem5",
"resources",
)
def test_obtain_resources_no_version(self):
"""Test that the resource loader returns latest version compatible with that version of gem5 when no version is specified."""
gem5Version = core.gem5Version
resource = obtain_resource(
resource_id="test-binary-resource",
resource_directory=self.get_resource_dir(),
)
self.assertEquals("2.5.0", resource.get_resource_version())
self.assertIsInstance(resource, BinaryResource)
# self.assertIn(gem5Version, resource.get_gem5_versions())
self.assertEquals("test description", resource.get_description())
self.assertEquals("src/test-source", resource.get_source())
self.assertEquals(ISA.ARM, resource.get_architecture())
def test_obtain_resources_with_version_compatible(self):
gem5Version = core.gem5Version
resource = obtain_resource(
resource_id="test-binary-resource",
resource_directory=self.get_resource_dir(),
resource_version="1.7.0",
)
self.assertEquals("1.7.0", resource.get_resource_version())
self.assertIsInstance(resource, BinaryResource)
# self.assertIn(gem5Version, resource.get_gem5_versions())
self.assertEquals(
"test description v1.7.0", resource.get_description()
)
self.assertEquals("src/test-source", resource.get_source())
self.assertEquals(ISA.ARM, resource.get_architecture())
def test_obtain_resources_with_version_incompatible(self):
resource = None
f = io.StringIO()
with contextlib.redirect_stderr(f):
resource = obtain_resource(
resource_id="test-binary-resource",
resource_directory=self.get_resource_dir(),
resource_version="1.5.0",
)
self.assertTrue(
f"warn: Resource test-binary-resource with version 1.5.0 is not known to be compatible with gem5 version {core.gem5Version}. "
"This may cause problems with your simulation. This resource's compatibility with different gem5 versions can be found here: "
f"https://resources.gem5.org/resources/test-binary-resource/versions"
in f.getvalue()
)
resource = obtain_resource(
resource_id="test-binary-resource",
resource_directory=self.get_resource_dir(),
resource_version="1.5.0",
)
self.assertEquals("1.5.0", resource.get_resource_version())
self.assertIsInstance(resource, BinaryResource)
self.assertEquals(
"test description for 1.5.0", resource.get_description()
)
self.assertEquals("src/test-source", resource.get_source())
self.assertEquals(ISA.ARM, resource.get_architecture())
def test_obtain_resources_no_version_invalid_id(self):
with self.assertRaises(Exception) as context:
obtain_resource(
resource_id="invalid-id",
resource_directory=self.get_resource_dir(),
)
self.assertTrue(
"Resource with ID 'invalid-id' not found."
in str(context.exception)
)
def test_obtain_resources_with_version_invalid_id(self):
with self.assertRaises(Exception) as context:
obtain_resource(
resource_id="invalid-id",
resource_directory=self.get_resource_dir(),
resource_version="1.7.0",
)
self.assertTrue(
"Resource with ID 'invalid-id' not found."
in str(context.exception)
)
def test_obtain_resources_with_version_invalid_version(self):
with self.assertRaises(Exception) as context:
obtain_resource(
resource_id="test-binary-resource",
resource_directory=self.get_resource_dir(),
resource_version="3.0.0",
)
print("context.exception: ", context.exception)
print(str(context.exception))
self.assertTrue(
f"Resource test-binary-resource with version '3.0.0'"
" not found.\nResource versions can be found at: "
f"https://resources.gem5.org/resources/test-binary-resource/versions"
in str(context.exception)
)

72
tests/pyunit/stdlib/resources/pyunit_resource_download_checks.py Normal file
View File

@@ -0,0 +1,72 @@
# Copyright (c) 2023 The Regents of the University of California
# All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions are
# met: redistributions of source code must retain the above copyright
# notice, this list of conditions and the following disclaimer;
# redistributions in binary form must reproduce the above copyright
# notice, this list of conditions and the following disclaimer in the
# documentation and/or other materials provided with the distribution;
# neither the name of the copyright holders nor the names of its
# contributors may be used to endorse or promote products derived from
# this software without specific prior written permission.
#
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
import unittest
import tempfile
import os
from typing import Dict
from gem5.resources.downloader import (
get_resources_json_obj,
)
class ResourceDownloadTestSuite(unittest.TestCase):
"""Test cases for gem5.resources.downloader"""
@classmethod
def setUpClass(cls) -> str:
pass
def get_resource_json_by_id(self) -> None:
"""Get a resource by its id"""
resources = get_resources_json_obj("test-version")
self.assertEqual(resources["id"], "test-version")
self.assertEqual(resources["resource_version"], "2.0.0")
def get_resource_json_invalid_id(self) -> None:
"""Should throw an exception when trying to get a resource that doesn't exist"""
with self.assertRaises(Exception) as context:
get_resources_json_obj("this-resource-doesnt-exist")
self.assertTrue(
f"Error: Resource with name 'this-resource-doesnt-exist' does not exist"
in str(context.exception)
)
def get_resource_json_by_id_and_version(self) -> None:
"""Get a resource by its id and version"""
resources = get_resources_json_obj("test-version", "1.0.0")
self.assertEqual(resources["id"], "test-version")
self.assertEqual(resources["resource_version"], "1.0.0")
def get_resource_json_by_id_and_invalid_version(self) -> None:
"""Get a resource by its id and an invalid version (does not exist)"""
with self.assertRaises(Exception) as context:
get_resources_json_obj("test-version", "3.0.0")
self.assertTrue(
f"Specified Version 3.0.0 does not exist for the resource 'test-version'."
in str(context.exception)
)

68
tests/pyunit/stdlib/resources/pyunit_resource_specialization.py
View File

@@ -37,7 +37,25 @@ from gem5.resources.looppoint import (
from gem5.isas import ISA
from gem5.resources.client_api.client_wrapper import ClientWrapper
from unittest.mock import patch
mock_json_path = Path(__file__).parent / "refs/resource-specialization.json"
mock_config_json = {
"sources": {
"baba": {
"url": mock_json_path,
"isMongo": False,
}
},
}
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_json),
)
class ResourceSpecializationSuite(unittest.TestCase):
"""This suite tests that `gem5.resource.resource` casts to the correct
`AbstractResource` specialization when using the `obtain_resource`
@@ -79,14 +97,14 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_binary_resource(self) -> None:
"""Tests the loading of of a BinaryResource"""
resource = obtain_resource(
resource_name="binary-example",
resource_id="binary-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, BinaryResource)
self.assertEquals(
"binary-example documentation.", resource.get_documentation()
"binary-example documentation.", resource.get_description()
)
self.assertEquals("src/simple", resource.get_source())
self.assertEquals(ISA.ARM, resource.get_architecture())
@@ -94,14 +112,14 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_kernel_resource(self) -> None:
"""Tests the loading of a KernelResource."""
resource = obtain_resource(
resource_name="kernel-example",
resource_id="kernel-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, KernelResource)
self.assertEquals(
"kernel-example documentation.", resource.get_documentation()
"kernel-example documentation.", resource.get_description()
)
self.assertEquals("src/linux-kernel", resource.get_source())
self.assertEquals(ISA.RISCV, resource.get_architecture())
@@ -109,14 +127,14 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_bootloader_resource(self) -> None:
"""Tests the loading of a BootloaderResource."""
resource = obtain_resource(
resource_name="bootloader-example",
resource_id="bootloader-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, BootloaderResource)
self.assertEquals(
"bootloader documentation.", resource.get_documentation()
"bootloader documentation.", resource.get_description()
)
self.assertIsNone(resource.get_source())
self.assertIsNone(resource.get_architecture())
@@ -124,14 +142,14 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_disk_image_resource(self) -> None:
"""Tests the loading of a DiskImageResource."""
resource = obtain_resource(
resource_name="disk-image-example",
resource_id="disk-image-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, DiskImageResource)
self.assertEquals(
"disk-image documentation.", resource.get_documentation()
"disk-image documentation.", resource.get_description()
)
self.assertEquals("src/x86-ubuntu", resource.get_source())
self.assertEquals("1", resource.get_root_partition())
@@ -139,40 +157,40 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_checkpoint_resource(self) -> None:
"""Tests the loading of a CheckpointResource."""
resource = obtain_resource(
resource_name="checkpoint-example",
resource_id="checkpoint-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, CheckpointResource)
self.assertEquals(
"checkpoint-example documentation.", resource.get_documentation()
"checkpoint-example documentation.", resource.get_description()
)
self.assertIsNone(resource.get_source())
def test_git_resource(self) -> None:
"""Tests the loading of a GitResource."""
resource = obtain_resource(
resource_name="git-example",
resource_id="git-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, GitResource)
self.assertIsNone(resource.get_documentation())
self.assertIsNone(resource.get_description())
self.assertIsNone(resource.get_source())
def test_simpoint_directory_resource(self) -> None:
"""Tests the loading of a Simpoint directory resource."""
resource = obtain_resource(
resource_name="simpoint-directory-example",
resource_id="simpoint-directory-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, SimpointDirectoryResource)
self.assertEquals(
"simpoint directory documentation.", resource.get_documentation()
"simpoint directory documentation.", resource.get_description()
)
self.assertIsNone(resource.get_source())
@@ -199,14 +217,14 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_simpoint_resource(self) -> None:
"""Tests the loading of a Simpoint resource."""
resource = obtain_resource(
resource_name="simpoint-example",
resource_id="simpoint-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, SimpointResource)
self.assertEquals(
"simpoint documentation.", resource.get_documentation()
"simpoint documentation.", resource.get_description()
)
self.assertIsNone(resource.get_source())
self.assertIsNone(resource.get_local_path())
@@ -219,26 +237,27 @@ class ResourceSpecializationSuite(unittest.TestCase):
def test_file_resource(self) -> None:
"""Tests the loading of a FileResource."""
resource = obtain_resource(
resource_name="file-example",
resource_id="file-example",
resource_directory=self.get_resource_dir(),
resource_version="1.0.0",
)
self.assertIsInstance(resource, FileResource)
self.assertIsNone(resource.get_documentation())
self.assertIsNone(resource.get_description())
self.assertIsNone(resource.get_source())
def test_directory_resource(self) -> None:
"""Tests the loading of a DirectoryResource."""
resource = obtain_resource(
resource_name="directory-example",
resource_id="directory-example",
resource_directory=self.get_resource_dir(),
)
self.assertIsInstance(resource, DirectoryResource)
self.assertEquals(
"directory-example documentation.", resource.get_documentation()
"directory-example documentation.", resource.get_description()
)
self.assertIsNone(resource.get_source())
@@ -247,7 +266,7 @@ class ResourceSpecializationSuite(unittest.TestCase):
pinpoints csv file."""
resource = obtain_resource(
resource_name="looppoint-pinpoint-csv-resource",
resource_id="looppoint-pinpoint-csv-resource",
resource_directory=self.get_resource_dir(),
)
@@ -258,7 +277,7 @@ class ResourceSpecializationSuite(unittest.TestCase):
self.assertIsInstance(resource, LooppointCsvLoader)
self.assertEquals(
"A looppoint pinpoints csv file.", resource.get_documentation()
"A looppoint pinpoints csv file.", resource.get_description()
)
self.assertIsNone(resource.get_source())
@@ -267,8 +286,9 @@ class ResourceSpecializationSuite(unittest.TestCase):
Looppoint JSON file."""
resource = obtain_resource(
resource_name="looppoint-json-restore-resource-region-1",
resource_id="looppoint-json-restore-resource-region-1",
resource_directory=self.get_resource_dir(),
resource_version="1.0.0",
)
self.assertIsInstance(resource, LooppointJsonResource)
@@ -278,6 +298,6 @@ class ResourceSpecializationSuite(unittest.TestCase):
self.assertTrue("1" in resource.get_regions())
self.assertEquals(
"A looppoint json file resource.", resource.get_documentation()
"A looppoint json file resource.", resource.get_description()
)
self.assertIsNone(resource.get_source())

42
tests/pyunit/stdlib/resources/pyunit_workload_checks.py
View File

@@ -1,4 +1,4 @@
# Copyright (c) 2022 The Regents of the University of California
# Copyright (c) 2023 The Regents of the University of California
# All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
@@ -36,6 +36,29 @@ from gem5.resources.resource import (
from typing import Dict
from gem5.resources.client_api.client_wrapper import ClientWrapper
from unittest.mock import patch
from pathlib import Path
mock_config_json1 = {
"sources": {
"baba": {
"url": Path(__file__).parent
/ "refs/workload-checks-custom-workload.json",
"isMongo": False,
}
},
}
mock_config_json2 = {
"sources": {
"baba": {
"url": Path(__file__).parent / "refs/workload-checks.json",
"isMongo": False,
}
},
}
class CustomWorkloadTestSuite(unittest.TestCase):
"""
@@ -43,8 +66,11 @@ class CustomWorkloadTestSuite(unittest.TestCase):
"""
@classmethod
@patch(
"gem5.resources.client.clientwrapper",
new=ClientWrapper(mock_config_json1),
)
def setUpClass(cls) -> None:
os.environ["GEM5_RESOURCE_JSON"] = os.path.join(
os.path.realpath(os.path.dirname(__file__)),
"refs",
@@ -114,8 +140,7 @@ class CustomWorkloadTestSuite(unittest.TestCase):
"test", self.custom_workload.get_parameters()["binary"]
)
# We set the overridden parameter back to it's old value.
self.custom_workload.set_parameter("binary", old_value)
# We set the overridden parameter back to it's old valu self.custom_workload.set_parameter("binary", old_value)
class WorkloadTestSuite(unittest.TestCase):
@@ -124,8 +149,11 @@ class WorkloadTestSuite(unittest.TestCase):
"""
@classmethod
@patch(
"gem5.resources.client.clientwrapper",
ClientWrapper(mock_config_json2),
)
def setUpClass(cls):
os.environ["GEM5_RESOURCE_JSON"] = os.path.join(
os.path.realpath(os.path.dirname(__file__)),
"refs",
@@ -157,9 +185,9 @@ class WorkloadTestSuite(unittest.TestCase):
self.assertTrue("kernel" in parameters)
self.assertTrue(isinstance(parameters["kernel"], BinaryResource))
self.assertTrue("disk_image" in parameters)
self.assertTrue("disk-image" in parameters)
self.assertTrue(
isinstance(parameters["disk_image"], DiskImageResource)
isinstance(parameters["disk-image"], DiskImageResource)
)
self.assertTrue("readfile_contents" in parameters)

30
tests/pyunit/stdlib/resources/refs/mongo_dup_mock.json Normal file
View File

@@ -0,0 +1,30 @@
[
{
"category": "file",
"id": "test-duplicate",
"description": "test",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
}
]

56
tests/pyunit/stdlib/resources/refs/mongo_mock.json Normal file
View File

@@ -0,0 +1,56 @@
[
{
"category": "disk-image",
"id": "x86-ubuntu-18.04-img",
"description": "This is a test resource",
"architecture": "X86",
"size": 688119691,
"tags": [
"x86",
"fullsystem"
],
"is_zipped": true,
"md5sum": "90e363abf0ddf22eefa2c7c5c9391c49",
"source": "src/x86-ubuntu",
"url": "http://dist.gem5.org/dist/develop/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"root_partition": "1",
"code_examples": [],
"license": "",
"author": [
"Ayaz Akram"
],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/x86-ubuntu",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
],
"example_usage": "get_resource(resource_name=\"x86-ubuntu-18.04-img\")"
},
{
"category": "disk-image",
"id": "x86-ubuntu-18.04-img",
"description": "A disk image containing Ubuntu 18.04 for x86. This image will run an `m5 readfile` instruction after booting. If no script file is specified an `m5 exit` instruction will be executed.",
"architecture": "X86",
"size": 688119691,
"tags": [
"x86",
"fullsystem"
],
"is_zipped": true,
"md5sum": "90e363abf0ddf22eefa2c7c5c9391c49",
"source": "src/x86-ubuntu",
"url": "http://dist.gem5.org/dist/develop/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"root_partition": "1",
"code_examples": [],
"license": "",
"author": [
"Ayaz Akram"
],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/x86-ubuntu",
"resource_version": "1.1.0",
"gem5_versions": [
"23.0"
],
"example_usage": "get_resource(resource_name=\"x86-ubuntu-18.04-img\")"
}
]

59
tests/pyunit/stdlib/resources/refs/obtain-resource.json Normal file
View File

@@ -0,0 +1,59 @@
[
{
"category": "binary",
"id": "test-binary-resource",
"description": "test description",
"architecture": "ARM",
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/test-progs/hello/bin/arm/linux/hello64-static",
"source": "src/test-source",
"resource_version": "2.5.0",
"gem5_versions": [
"25.0"
]
},
{
"category": "binary",
"id": "test-binary-resource",
"description": "test description",
"architecture": "ARM",
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/test-progs/hello/bin/arm/linux/hello64-static",
"source": "src/test-source",
"resource_version": "2.0.0",
"gem5_versions": [
"develop"
]
},
{
"category": "binary",
"id": "test-binary-resource",
"description": "test description v1.7.0",
"architecture": "ARM",
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/test-progs/hello/bin/arm/linux/hello64-static",
"source": "src/test-source",
"resource_version": "1.7.0",
"gem5_versions": [
"develop"
]
},
{
"category": "binary",
"id": "test-binary-resource",
"description": "test description for 1.5.0",
"architecture": "ARM",
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/test-progs/hello/bin/arm/linux/hello64-static",
"source": "src/test-source",
"resource_version": "1.5.0",
"gem5_versions": [
"21.1",
"22.1"
]
}
]

311
tests/pyunit/stdlib/resources/refs/resource-specialization.json
View File

@@ -1,132 +1,181 @@
{
"version" : "develop",
"url_base" : "http://dist.gem5.org/dist/v22-1",
"previous-versions" : {
"develop" : "https://gem5.googlesource.com/public/gem5-resources/+/refs/heads/develop/resources.json?format=TEXT",
"21.2" : "http://resources.gem5.org/prev-resources-json/resources-21-2.json"
[
{
"category": "kernel",
"id": "kernel-example",
"description": "kernel-example documentation.",
"architecture": "RISCV",
"is_zipped": false,
"md5sum": "60a53c7d47d7057436bf4b9df707a841",
"url": "http://dist.gem5.org/dist/develop/kernels/x86/static/vmlinux-5.4.49",
"source": "src/linux-kernel",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
"resources": [
{
"type" : "kernel",
"name" : "kernel-example",
"documentation" : "kernel-example documentation.",
"architecture" : "RISCV",
"is_zipped" : false,
"md5sum" : "60a53c7d47d7057436bf4b9df707a841",
"url" : "{url_base}/kernels/x86/static/vmlinux-5.4.49",
"source" : "src/linux-kernel"
},
{
"type" : "disk-image",
"name" : "disk-image-example",
"documentation" : "disk-image documentation.",
"architecture" : "X86",
"is_zipped" : true,
"md5sum" : "90e363abf0ddf22eefa2c7c5c9391c49",
"url" : "{url_base}/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"source" : "src/x86-ubuntu",
"root_partition": "1"
},
{
"type" : "binary",
"name" : "binary-example",
"documentation" : "binary-example documentation.",
"architecture" : "ARM",
"is_zipped" : false,
"md5sum" : "71b2cb004fe2cda4556f0b1a38638af6",
"url" : "{url_base}/test-progs/hello/bin/arm/linux/hello64-static",
"source" : "src/simple"
},
{
"type" : "bootloader",
"name" : "bootloader-example",
"documentation" : "bootloader documentation.",
"is_zipped" : false,
"md5sum" : "71b2cb004fe2cda4556f0b1a38638af6",
"url" : "{url_base}/test-progs/hello/bin/arm/linux/hello64-static"
},
{
"type" : "checkpoint",
"name" : "checkpoint-example",
"documentation" : "checkpoint-example documentation.",
"architecture": "RISCV",
"is_zipped" : false,
"md5sum" : "3a57c1bb1077176c4587b8a3bf4f8ace",
"source" : null,
"is_tar_archive" : true,
"url": "{url_base}/checkpoints/riscv-hello-example-checkpoint.tar"
},
{
"type" : "git",
"name" : "git-example",
"documentation" : null,
"is_zipped" : false,
"is_tar_archive" : true,
"md5sum" : "71b2cb004fe2cda4556f0b1a38638af6",
"url": "{url_base}/checkpoints/riscv-hello-example-checkpoint.tar"
},
{
"type" : "file",
"name" : "file-example",
"documentation" : null,
"is_zipped" : false,
"md5sum" : "71b2cb004fe2cda4556f0b1a38638af6",
"url": "{url_base}/checkpoints/riscv-hello-example-checkpoint.tar",
"source" : null
},
{
"type" : "directory",
"name" : "directory-example",
"documentation" : "directory-example documentation.",
"is_zipped" : false,
"md5sum" : "3a57c1bb1077176c4587b8a3bf4f8ace",
"source" : null,
"is_tar_archive" : true,
"url": "{url_base}/checkpoints/riscv-hello-example-checkpoint.tar"
},
{
"type": "simpoint-directory",
"name": "simpoint-directory-example",
"documentation": "simpoint directory documentation.",
"is_zipped" : false,
"md5sum" : "3fcffe3956c8a95e3fb82e232e2b41fb",
"source" : null,
"is_tar_archive" : true,
"url": "{url_base}/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"simpoint_file": "simpoint.simpt",
"weight_file": "simpoint.weight",
"workload_name": "Example Workload"
},
{
"type": "simpoint",
"name": "simpoint-example",
"documentation": "simpoint documentation.",
"simpoint_interval": 1000000,
"warmup_interval": 23445,
"simpoint_list" : [2,3,4,15],
"weight_list" : [0.1, 0.2, 0.4, 0.3]
},
{
"type": "looppoint-pinpoint-csv",
"name": "looppoint-pinpoint-csv-resource",
"documentation" : "A looppoint pinpoints csv file.",
"is_zipped" : false,
"md5sum" : "199ab22dd463dc70ee2d034bfe045082",
"url": "http://dist.gem5.org/dist/develop/pinpoints/x86-matrix-multiply-omp-100-8-global-pinpoints-20230127",
"source" : null
},
{
"type": "looppoint-json",
"name": "looppoint-json-restore-resource-region-1",
"documentation" : "A looppoint json file resource.",
"is_zipped" : false,
"region_id" : "1",
"md5sum" : "a71ed64908b082ea619b26b940a643c1",
"url": "http://dist.gem5.org/dist/develop/looppoints/x86-matrix-multiply-omp-100-8-looppoint-json-20230128",
"source" : null
}
]
}
{
"category": "disk-image",
"id": "disk-image-example",
"description": "disk-image documentation.",
"architecture": "X86",
"is_zipped": true,
"md5sum": "90e363abf0ddf22eefa2c7c5c9391c49",
"url": "http://dist.gem5.org/dist/develop/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"source": "src/x86-ubuntu",
"root_partition": "1",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "binary",
"id": "binary-example",
"description": "binary-example documentation.",
"architecture": "ARM",
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/test-progs/hello/bin/arm/linux/hello64-static",
"source": "src/simple",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "bootloader",
"id": "bootloader-example",
"description": "bootloader documentation.",
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/test-progs/hello/bin/arm/linux/hello64-static",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "checkpoint",
"id": "checkpoint-example",
"description": "checkpoint-example documentation.",
"architecture": "RISCV",
"is_zipped": false,
"md5sum": "3a57c1bb1077176c4587b8a3bf4f8ace",
"source": null,
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/checkpoints/riscv-hello-example-checkpoint.tar",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "git",
"id": "git-example",
"description": null,
"is_zipped": false,
"is_tar_archive": true,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/checkpoints/riscv-hello-example-checkpoint.tar",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "file",
"id": "file-example",
"description": null,
"is_zipped": false,
"md5sum": "71b2cb004fe2cda4556f0b1a38638af6",
"url": "http://dist.gem5.org/dist/develop/checkpoints/riscv-hello-example-checkpoint.tar",
"source": null,
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "directory",
"id": "directory-example",
"description": "directory-example documentation.",
"is_zipped": false,
"md5sum": "3a57c1bb1077176c4587b8a3bf4f8ace",
"source": null,
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/checkpoints/riscv-hello-example-checkpoint.tar",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "simpoint-directory",
"id": "simpoint-directory-example",
"description": "simpoint directory documentation.",
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"source": null,
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"simpoint_file": "simpoint.simpt",
"weight_file": "simpoint.weight",
"workload_name": "Example Workload",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "simpoint",
"id": "simpoint-example",
"description": "simpoint documentation.",
"simpoint_interval": 1000000,
"warmup_interval": 23445,
"simpoint_list": [
2,
3,
4,
15
],
"weight_list": [
0.1,
0.2,
0.4,
0.3
],
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "looppoint-pinpoint-csv",
"id": "looppoint-pinpoint-csv-resource",
"description": "A looppoint pinpoints csv file.",
"is_zipped": false,
"md5sum": "199ab22dd463dc70ee2d034bfe045082",
"url": "http://dist.gem5.org/dist/develop/pinpoints/x86-matrix-multiply-omp-100-8-global-pinpoints-20230127",
"source": null,
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "looppoint-json",
"id": "looppoint-json-restore-resource-region-1",
"description": "A looppoint json file resource.",
"is_zipped": false,
"region_id": "1",
"md5sum": "a71ed64908b082ea619b26b940a643c1",
"url": "http://dist.gem5.org/dist/develop/looppoints/x86-matrix-multiply-omp-100-8-looppoint-json-20230128",
"source": null,
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
}
]

329
tests/pyunit/stdlib/resources/refs/resources.json Normal file
View File

@@ -0,0 +1,329 @@
[
{
"category": "binary",
"id": "this-is-a-test-resource",
"description": "This is a test resource",
"architecture": "X86",
"size": 13816,
"tags": [
"asmtest",
"testing",
"riscv",
"testing"
],
"is_zipped": false,
"md5sum": "4e70a98b6976969deffff91eed17fba1",
"source": "src/asmtest",
"url": "http://dist.gem5.org/dist/develop/test-progs/asmtest/bin/rv64mi-p-sbreak",
"code_examples": [],
"license": " BSD-3-Clause",
"author": [],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
],
"example_usage": "get_resource(resource_name=\"rv64mi-p-sbreak\")"
},
{
"category": "binary",
"id": "this-is-a-test-resource",
"description": "This is a test resource but newer",
"architecture": "X86",
"size": 13816,
"tags": [
"asmtest",
"testing",
"riscv",
"testing",
"new"
],
"is_zipped": false,
"md5sum": "4e70a98b6976969deffff91eed17fba1",
"source": "src/asmtest",
"url": "http://dist.gem5.org/dist/develop/test-progs/asmtest/bin/rv64mi-p-sbreak",
"code_examples": [],
"license": " BSD-3-Clause",
"author": [],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
"resource_version": "1.1.0",
"gem5_versions": [
"23.0"
],
"example_usage": "get_resource(resource_name=\"rv64mi-p-sbreak\")"
},
{
"category": "binary",
"id": "this-is-a-test-resource",
"description": "This is a test resource but double newer",
"architecture": "X86",
"size": 13816,
"tags": [
"asmtest"
],
"is_zipped": false,
"md5sum": "4e70a98b6976969deffff91eed17fba1",
"source": "src/asmtest",
"url": "http://dist.gem5.org/dist/develop/test-progs/asmtest/bin/rv64mi-p-sbreak",
"code_examples": [],
"license": " BSD-3-Clause",
"author": [],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/asmtest",
"resource_version": "2.0.0",
"gem5_versions": [
"23.1"
],
"example_usage": "get_resource(resource_name=\"rv64mi-p-sbreak\")"
},
{
"category": "simpoint",
"id": "test-version",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "test-version",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "test-duplicate",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "aa",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "asfsaf",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "simpoint-resource",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "bat43f34fman",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "file",
"id": "adadadas",
"description": "Simpoints for running the 'x86-print-this' resource with the parameters `\"print this\" 15000`. This is encapsulated in the 'x86-print-this-15000-with-simpoints' workload.",
"architecture": "X86",
"size": 10240,
"tags": [],
"is_zipped": false,
"md5sum": "3fcffe3956c8a95e3fb82e232e2b41fb",
"is_tar_archive": true,
"url": "http://dist.gem5.org/dist/develop/simpoints/x86-print-this-15000-simpoints-20221013.tar",
"simpoint_interval": 1000000,
"warmup_interval": 1000000,
"code_examples": [],
"license": "",
"author": [],
"source_url": "",
"resource_version": "0.2.0",
"gem5_versions": [
"23.0"
],
"workload_name": "x86-print-this-15000-with-simpoints",
"example_usage": "get_resource(resource_name=\"x86-print-this-1500-simpoints\")",
"workloads": [
"x86-print-this-15000-with-simpoints",
"x86-print-this-15000-with-simpoints-and-checkpoint"
]
},
{
"category": "disk-image",
"id": "x86-ubuntu-18.04-img",
"description": "This is a test resource",
"architecture": "X86",
"size": 688119691,
"tags": [
"x86",
"fullsystem"
],
"is_zipped": true,
"md5sum": "90e363abf0ddf22eefa2c7c5c9391c49",
"source": "src/x86-ubuntu",
"url": "http://dist.gem5.org/dist/develop/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"root_partition": "1",
"code_examples": [],
"license": "",
"author": [
"Ayaz Akram"
],
"source_url": "https://github.com/gem5/gem5-resources/tree/develop/src/x86-ubuntu",
"resource_version": "2.0.0",
"gem5_versions": [
"23.0"
],
"example_usage": "get_resource(resource_name=\"x86-ubuntu-18.04-img\")"
}
]

33
tests/pyunit/stdlib/resources/refs/workload-checks-custom-workload.json
View File

@@ -1,17 +1,16 @@
{
"version" : null,
"url_base" : "http://dist.gem5.org/dist/v22-0",
"previous-versions" : {},
"resources": [
{
"type" : "binary",
"name" : "x86-hello64-static",
"documentation" : "A 'Hello World!' binary.",
"architecture" : "X86",
"is_zipped" : false,
"md5sum" : "dbf120338b37153e3334603970cebd8c",
"url" : "{url_base}/test-progs/hello/bin/x86/linux/hello64-static",
"source" : "src/simple"
}
]
}
[
{
"category": "binary",
"id": "x86-hello64-static",
"description": "A 'Hello World!' binary.",
"architecture": "X86",
"is_zipped": false,
"md5sum": "dbf120338b37153e3334603970cebd8c",
"url": "{url_base}/test-progs/hello/bin/x86/linux/hello64-static",
"source": "src/simple",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
}
]

84
tests/pyunit/stdlib/resources/refs/workload-checks.json
View File

@@ -1,40 +1,48 @@
{
"url_base" : "http://dist.gem5.org/dist/v22-0",
"previous-versions" : {},
"resources": [
{
"type" : "kernel",
"name" : "x86-linux-kernel-5.2.3",
"documentation" : "The linux kernel (v5.2.3), compiled to X86.",
"architecture" : "X86",
"is_zipped" : false,
"md5sum" : "4838c99b77d33c8307b939c16624e4ac",
"url" : "{url_base}/kernels/x86/static/vmlinux-5.2.3",
"source" : "src/linux-kernel"
[
{
"category": "kernel",
"id": "x86-linux-kernel-5.2.3",
"description": "The linux kernel (v5.2.3), compiled to X86.",
"architecture": "X86",
"is_zipped": false,
"md5sum": "4838c99b77d33c8307b939c16624e4ac",
"url": "{url_base}/kernels/x86/static/vmlinux-5.2.3",
"source": "src/linux-kernel",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "disk-image",
"id": "x86-ubuntu-18.04-img",
"description": "A disk image containing Ubuntu 18.04 for x86..",
"architecture": "X86",
"is_zipped": true,
"md5sum": "90e363abf0ddf22eefa2c7c5c9391c49",
"url": "{url_base}/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"source": "src/x86-ubuntu",
"root_partition": "1",
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
},
{
"category": "workload",
"id": "simple-boot",
"description": "Description of workload here",
"function": "set_kernel_disk_workload",
"resources": {
"kernel": "x86-linux-kernel-5.2.3",
"disk-image": "x86-ubuntu-18.04-img"
},
{
"type" : "disk-image",
"name" : "x86-ubuntu-18.04-img",
"documentation" : "A disk image containing Ubuntu 18.04 for x86..",
"architecture" : "X86",
"is_zipped" : true,
"md5sum" : "90e363abf0ddf22eefa2c7c5c9391c49",
"url" : "{url_base}/images/x86/ubuntu-18-04/x86-ubuntu.img.gz",
"source" : "src/x86-ubuntu",
"root_partition": "1"
"additional_params": {
"readfile_contents": "echo 'Boot successful'; m5 exit"
},
{
"type" : "workload",
"name" : "simple-boot",
"documentation" : "Description of workload here",
"function" : "set_kernel_disk_workload",
"resources" : {
"kernel" : "x86-linux-kernel-5.2.3",
"disk_image" : "x86-ubuntu-18.04-img"
},
"additional_params" : {
"readfile_contents" : "echo 'Boot successful'; m5 exit"
}
}
]
}
"resource_version": "1.0.0",
"gem5_versions": [
"23.0"
]
}
]