Skip to content

Commit

Permalink
rename the remaining stuff
Browse files Browse the repository at this point in the history
  • Loading branch information
beneisner committed May 14, 2024
1 parent ff3798d commit 5b26ff2
Show file tree
Hide file tree
Showing 16 changed files with 24 additions and 305 deletions.
3 changes: 0 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -70,9 +70,6 @@ pip install -r requirements-gpu.txt
```


# NOTE
Cursed vglrun requires us to pipe in our own custom LD_LIBRARY_PATH. This is a hacky way to do it, but it works for now.

## Install `taxpose`.

This part should be really simple:
Expand Down
25 changes: 7 additions & 18 deletions notebooks/aggregate_rlbench_results.ipynb
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Aggregate the various rlbench evals into a single dataframe which can be easily copied."
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down Expand Up @@ -92,24 +99,6 @@
"display(df)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"cfg = get_config(run_ids[1])"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"cfg[\"task\"][\"name\"]"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Explore the RLBench dataset (which we made)"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down
File renamed without changes.
File renamed without changes.
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# NDF evaluation result aggregation"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
4 changes: 2 additions & 2 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,6 @@ authors = [
]
dependencies = [
# "chamferdist",
"dill",
"dgl",
"dglgo",
"h5py",
Expand Down Expand Up @@ -56,13 +55,14 @@ develop = [
"pytest-xdist",
"types-tqdm",
]
build_docs = ["mkdocs-material", "mkdocstrings[python]"]
rlbench = [
# These should be installed manually...
# "pyrep",
# "rlbench @ git+https://github.com/stepjam/RLBench.git",
"rpad-rlbench-utils @ git+https://github.com/r-pad/rlbench_utils.git",
]
build_docs = ["mkdocs-material", "mkdocstrings[python]"]


# This is required to allow us to have notebooks/ at the top level.
[tool.setuptools]
Expand Down
247 changes: 1 addition & 246 deletions scripts/README.md

Large diffs are not rendered by default.

36 changes: 0 additions & 36 deletions scripts/get_results.py
Original file line number Diff line number Diff line change
Expand Up @@ -21,42 +21,6 @@ def main(res_dir: str, n_trials: int = 100):
# Get the path to the result file
result_path = os.path.join(res_dir, seed, result_file)

# res = np.load(result_path)
# # Set the index of the dataframe to be the seed

# succ = np.logical_and(
# res["grasp_success_list"], res["place_success_teleport_list"]
# )
# mp_succ = np.logical_and(res["grasp_success_list"], res["place_success_list"])

# ress = {
# "seed": seed,
# "Grasp": res["grasp_success_list"].astype(float).mean(),
# "Place": res["place_success_teleport_list"].astype(float).mean(),
# "Overall": succ.astype(float).mean(),
# "Overall_mp": mp_succ.astype(float).mean(),
# }

# for thresh in [0.0, 0.01, 0.02, 0.03, 0.04, 0.05]:
# ps_at_t = np.logical_and(
# res["place_success_teleport_list"], res["penetration_list"] < thresh
# ).mean(axis=-1)
# s_at_t = np.logical_and(succ, res["penetration_list"] < thresh).mean(
# axis=-1
# )

# ress[f"Place@{thresh}"] = ps_at_t.mean()
# ress[f"Overall@{thresh}"] = s_at_t.mean()

# results = pd.DataFrame(
# ress,
# columns=["seed", "Grasp", "Place", "Overall", "Overall_mp"]
# + [f"Place@{thresh}" for thresh in [0.0, 0.01, 0.02, 0.03, 0.04, 0.05]]
# + [f"Overall@{thresh}" for thresh in [0.0, 0.01, 0.02, 0.03, 0.04, 0.05]],
# index=[0],
# )
# # set the seed column as the index
# results.set_index("seed", inplace=True)
results = get_result_df(result_path, seed)
dfs.append(results)

Expand Down

0 comments on commit 5b26ff2

Please sign in to comment.