profile
viewpoint
If you are wondering where the data of this site comes from, please visit https://api.github.com/users/martinjm97/events. GitMemory does not store any data, but only uses NGINX to cache data for a period of time. The idea behind GitMemory is simply to give users a better reading experience.
Jesse Michel martinjm97 PhD Student at MIT United States http://web.mit.edu/jmmichel/www/

swansonk14/typed-argument-parser 155

Typed argument parser for Python

martinjm97/ENNUI 100

An Elegant Neural Network User Interface to build drag-and-drop neural networks, train in the browser, visualize during training, and export to Python.

ChezJrk/Teg 21

A differentiable programming language with an integration primitive that soundly handles interactions among the derivative, integral, and discontinuities.

ChezJrk/teg_applications 7

Applications of the Teg differentiable programming language to problems spanning graphics and physical simulation.

psg-mit/marshall 4

Our modifications of the Marshall language for exact real arithmetic and examples

martinjm97/GeoMax.jl 3

Uses the geometric structure of specific manifolds for optimization in Julia inspired by ManOpt

popabczhang/Realtime_Sim 3

Realtime Simulation on CityScope Project

martinjm97/DRGG 1

Implementation and evaluation of the Directed Random Geometric Graph model

psg-mit/fast_reals 1

Sensitivities for Guiding Refinement in Arbitrary-Precision Arithmetic

issue closedswansonk14/typed-argument-parser

`underscore_to_dashes` isn't propagated to subparsers

My example is:

class AddProposal(Tap):
    proposal_id: int

class Arguments(Tap):
    def configure(self) -> None:
        self.add_subparsers(dest="subparser_name")

        self.add_subparser(
            "add-proposal",
            AddProposal,
            help="Add a new proposal",
        )

args = Arguments(underscores_to_dashes=True).parse_args()

Typing python myapp.py add-proposal --help I get proposal_id as an argument

closed time in 2 months

pmiddend

issue closedswansonk14/typed-argument-parser

Document pathlib support

I figured having pathlib Path type support would be nice.

I decided to fork to add the support. After some digging I decided I would add a test. Turns out, there already are tests for this, and they pass.

Since this is a cool feature, might want to add it to the Readme.md.

closed time in 2 months

bartMarinissen

issue commentswansonk14/typed-argument-parser

Document pathlib support

Hi @bartMarinissen,

Great point. It's updated as of https://github.com/swansonk14/typed-argument-parser/commit/b96be4e903cdacae6c518f8b0dbb8f866e6f8ec1.

Thanks, Jesse

bartMarinissen

comment created time in 2 months

push eventswansonk14/typed-argument-parser

Jesse Michel

commit sha b96be4e903cdacae6c518f8b0dbb8f866e6f8ec1

Update README.md

view details

push time in 2 months

push eventmartinjm97/PersonalWebsite

Jesse Michel

commit sha 57769e06ae2abc3a4941170d474287bb4b8e7175

Updated the description text

view details

push time in 2 months

push eventmartinjm97/PersonalWebsite

Jesse Michel

commit sha a87374f3fed4d9e23d67be883f0acfd7642e5004

Master thesis and some reorganization

view details

push time in 2 months

issue closedpdlan/OSCAR

Trouble with make in the Docker image provided

Hi,

I built the dependencies for the docker image that you provided, but when I run make in /oscar/bin, I get:

cd ../irlexer && go build && cp irlexer ../bin
main.go:14:2: cannot find package "github.com/ianlancetaylor/demangle" in any of:
	/usr/lib/go-1.10/src/github.com/ianlancetaylor/demangle (from $GOROOT)
	/root/go/src/github.com/ianlancetaylor/demangle (from $GOPATH)
main.go:15:2: cannot find package "github.com/llir/ll" in any of:
	/usr/lib/go-1.10/src/github.com/llir/ll (from $GOROOT)
	/root/go/src/github.com/llir/ll (from $GOPATH)
Makefile:5: recipe for target 'irlexer' failed
make: *** [irlexer] Error 1

Best, Jesse

closed time in 2 months

martinjm97

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

I see. I was training on an instance with a single GPU. I can scale up easily, but I'll first go back and think over my evaluation methodology. After that, I might send a follow up email your way. Thanks again!

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

How long should pretraining take? It stopped producing output after about half an hour.

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

The new docker command still didn't allow me to preprocess the data, however, the processed data did allow me to pretrain the model. Thank you for adding that!

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

With the updated data, I still get the same error. My tree is:

├── 0
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 1
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 10
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 11
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 12
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 13
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 14
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 15
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 16
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 17
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 18
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 19
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 2
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 3
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 4
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 5
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 6
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 7
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 8
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 9
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── inst_dict.txt
└── state_dict.txt
martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

Also, there's a missing dependency uuidgen, which can be added with apt-get install uuid-runtime.

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

├── 0
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 1
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 10
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 11
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 12
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 13
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 14
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 15
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 16
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 17
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 18
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 19
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 2
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 3
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 4
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 5
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 6
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 7
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 8
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── 9
│   ├── insts
│   │   └── dict.txt
│   ├── pos
│   │   ├── train.bin
│   │   ├── train.idx
│   │   ├── valid.bin
│   │   └── valid.idx
│   └── states
│       ├── dict.txt
│       ├── train.bin
│       └── train.idx
├── inst_dict.txt
└── state_dict.txt
martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

Yes, it exists and contains: 0 10 12 14 16 18 2 4 6 8 inst_dict.txt 1 11 13 15 17 19 3 5 7 9 state_dict.txt.

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

Oh that's totally my bad. I had multiple versions of the repo and looked at the wrong one. On the latest version I get:

  File "train.py", line 350, in <module>
    cli_main()
  File "train.py", line 346, in cli_main
    main(args)
  File "train.py", line 48, in main
    task.load_dataset(valid_sub_split, combine=False, epoch=0)
  File "/oscar/OSCAR/model/fairseq/tasks/ir_masked_lm.py", line 119, in load_dataset
    raise FileNotFoundError('Dataset not found: {} ({})'.format(split, split_path))
NameError: name 'split_path' is not defined

I think this is a bug in an error message that arises as a result of some data missing from the pretrain folder (downloaded from the OneDrive link) such as imagemagick, linux-vmlinux, etc.

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

Thanks for the reference, I'll comment that import statement out. Likewise for IRBlockDataset in model/fairseq/tasks/poj_similarity.py.

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

Yes, with the latest commit, I get the following error:

./scripts/pretrain.sh 
Traceback (most recent call last):
  File "setup.py", line 16, in <module>
    with open('README.md') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'README.md'
Traceback (most recent call last):
  File "train.py", line 17, in <module>
    from fairseq import checkpoint_utils, distributed_utils, options, progress_bar, tasks, utils
  File "/oscar/OSCAR/model/fairseq/__init__.py", line 9, in <module>
    import fairseq.criterions  # noqa
  File "/oscar/OSCAR/model/fairseq/criterions/__init__.py", line 24, in <module>
    importlib.import_module('fairseq.criterions.' + module)
  File "/opt/conda/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/oscar/OSCAR/model/fairseq/criterions/adaptive_loss.py", line 10, in <module>
    from fairseq import utils
  File "/oscar/OSCAR/model/fairseq/utils.py", line 20, in <module>
    from fairseq.modules import gelu, gelu_accurate
  File "/oscar/OSCAR/model/fairseq/modules/__init__.py", line 28, in <module>
    from .irexp_transformer_sentence_encoder import IRTransformerSentenceEncoderNoMiddleLayers
ModuleNotFoundError: No module named 'fairseq.modules.irexp_transformer_sentence_encoder'
martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

Update: Even with new dependencies, I still can't run OSCAR without errors.

martinjm97

comment created time in 2 months

issue commentpdlan/OSCAR

Trouble with make in the Docker image provided

I updated to the latest version of go in the docker image and then ran go mod tidy in the irlexer directory.

martinjm97

comment created time in 3 months

issue openedpdlan/OSCAR

Trouble with make in the Docker image provided

Hi,

I built the dependencies for the docker image that you provided, but when I run make in /oscar/bin, I get:

cd ../irlexer && go build && cp irlexer ../bin
main.go:14:2: cannot find package "github.com/ianlancetaylor/demangle" in any of:
	/usr/lib/go-1.10/src/github.com/ianlancetaylor/demangle (from $GOROOT)
	/root/go/src/github.com/ianlancetaylor/demangle (from $GOPATH)
main.go:15:2: cannot find package "github.com/llir/ll" in any of:
	/usr/lib/go-1.10/src/github.com/llir/ll (from $GOROOT)
	/root/go/src/github.com/llir/ll (from $GOPATH)
Makefile:5: recipe for target 'irlexer' failed
make: *** [irlexer] Error 1

Thanks, Jesse

created time in 3 months