Bad indentation in resnet-binary.py

Bad code is frustrating for people who wants to reproduce your results. There's a clear incorrect indentation
in line 170 here so python train_cifar10.py --network resnet-binary cannot be executed as it was instructed here!
Even a small mistake damages the credibility of the results!

to reproduce the result on cifar10, you don't need to change anything in "resnet-binary.py". The mentioned code line "170" is the experimental setting which was used to help us to build a model with both binary and full precision layer blocks. Those results have been also reported in our paper on imagenet dataset (ref. Table 2, have you ever read the paper before?). So I don't understand what your mean about this and the training on cifar10. We don't have any problem to run the training on cifar10, by using command line code like this:
python train_cifar10.py --log cifar10.log --data-train /data/mxnet_data/cifar10/cifar10_train.rec --data-val  /data/mxnet_data/cifar10/cifar10_val.rec --network resnet-binary --gpus=0
INFO:root:start with arguments Namespace(batch_size=128, benchmark=0, data_nthreads=4, data_train='/data/mxnet_data/cifar10/cifar10_train.rec', data_val='/data/mxnet_data/cifar10/cifar10_val.rec', disp_batches=100, gpus='0', image_shape='3,32,32', kv_store='device', load_epoch=None, log_file='cifar10.log', lr=0.01, lr_factor=0.1, lr_step_epochs='50,200,250', max_random_aspect_ratio=0.25, max_random_h=36, max_random_l=50, max_random_rotate_angle=10, max_random_s=50, max_random_scale=1, max_random_shear_ratio=0.1, min_random_scale=1, model_prefix=None, mom=0.9, monitor=0, network='resnet-binary', num_classes=10, num_epochs=300, num_examples=50000, num_layers=18, optimizer='Adam', pad_size=0, pretrained=None, random_crop=1, random_mirror=1, rgb_mean='123.68,116.779,103.939', test_io=0, top_k=0, wd=0.0001)
[09:50:10] /home/workspace/mxnet-HPI/src/io/iter_image_recordio_2.cc:170: ImageRecordIOParser2: /data/mxnet_data/cifar10/cifar10_train.rec, use 4 threads for decoding..
[09:50:11] /home/workspace/mxnet-HPI/src/io/iter_image_recordio_2.cc:170: ImageRecordIOParser2: /data/mxnet_data/cifar10/cifar10_val.rec, use 4 threads for decoding..
[09:50:14] /home/workspace/mxnet-HPI/src/operator/././cudnn_algoreg-inl.h:107: Running performance tests to find the best convolution algorithm, this can take a while... (setting env variable MXNET_CUDNN_AUTOTUNE_DEFAULT to 0 to disable)
INFO:root:Epoch[0] Batch [100]  Speed: 1754.40 samples/sec      accuracy=0.180152
INFO:root:Epoch[0] Batch [200]  Speed: 1805.58 samples/sec      accuracy=0.204687
INFO:root:Epoch[0] Batch [300]  Speed: 1754.10 samples/sec      accuracy=0.247969
INFO:root:Epoch[0] Train-accuracy=0.272049
INFO:root:Epoch[0] Time cost=28.592
INFO:root:Epoch[0] Validation-accuracy=0.271163
INFO:root:Epoch[1] Batch [100]  Speed: 1747.23 samples/sec      accuracy=0.294013

@yanghaojin  thanks for your reply! I'm sorry I voiced my frustration inappropriately.  You're right, there shouldn't be any issue.


Cody Gray: Watch proarticlepost.com

Cody Gray requests the watch of the watch_keyword proarticlepost\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

proarticlepost\.com has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by Spevacus in Charcoal HQ


restic hangs randomly on backup, prune or check

Output of restic version
restic 0.12.0 compiled with go1.15.8 on windows/amd64
How did you run restic exactly?

restic backup --password-file "%USERPROFILE%\%PASSWORD_FILE_PATH%" --repo "%USERPROFILE%\%REPO_PATH%" %USERPROFILE%\%DATA_PATH% --exclude-file=%USERPROFILE%\%EXCLUDE_FILE_PATH% --verbose=3
restic check --password-file "%USERPROFILE%\%PASSWORD_FILE_PATH%" --repo "%USERPROFILE%\%REPO_PATH%" --verbose=3
restic prune --password-file "%USERPROFILE%\%PASSWORD_FILE_PATH%" --repo "%USERPROFILE%\%REPO_PATH%" --verbose=3
What backend/server/service did you use to store the repository?
The same drive containing the backed-up data (my %USERPROFILE% on C:, on a Windows 10 laptop, with a NTFS file system).
Expected behavior

Perform the backup/prune/check entirely.
Actual behavior

Until now, restic 0.11 worked without problem on my laptop.
But since about a week ago, it started hanging during backup.
Here is the output of a backup with --verbose=3:
open repository
repository 1a2b3c4d opened successfully, password is correct
lock repository
load index files
unchanged /C/Users/...
...
unchanged /C/Users/...
[0:24] 503 files 2.009 GiB, total 1827 files 9.312 GiB, 17 errors

But during the backup, it just stops at random: the "unchanged" files printing stops, and the "progress" line stops being updated, except for the time spent between square brackets (and the ETA when there is one), for a couple seconds, before stopping too.
It does not stop at a specific time or file, it really seems random.
Sometimes, when it stops, the "progress" line is empty.
Rarely, it even stops before that, at the "load index files" or even the "open repository" lines.
When it stops, Ctrl+C does nothing, I have to close the window.
(The errors where present before this issue, it's just some Cygwin "symlinks" that can't be accessed by restic)
I have 3 folders to backup, one with less than 100 files, one with about 7000 files, and one with about 130000 files.
It rarely stops during the small one's backup (and when it does, it's during "open repository" or "load index files"), about 50% of the time during the middle one's backup, and 100% of the time during the big one's backup.
I tried using a new repository, without improvement.
When I do, init works fine, and the first backup too (even with the big folder), but then it starts stopping randomly again.
When I try a check on the repo after a failed backup, of course it says:
unable to create lock in backend: repository is already locked by PID 12345 on MACHINE by USER (UID 0, GID 0)

But when I use unlock on the repo, even if it says that it successfully removed locks, some lock files are still present in the lock directory of the repo.
If I remove them manually and retry the check, it proceeds, but then stops too:
using temporary cache in C:\Users\...
repository 1a2b3c4d opened successfully, password is correct
created new cache in C:\Users\...
create exclusive lock for repository
load indexes
check all packs
check snapshots, trees and blobs
[0:05] 23.33%  7 / 30 snapshots

After a couple of seconds, the "progress" line stops updating.
Same thing with prune:
repository 1a2b3c4d opened successfully, password is correct
loading indexes...
loading all snapshots...
finding data that is still in use for 30 snapshots
[0:14] 23.33%  7 / 30 snapshots

Using an account with admin rights didn't improve anything.
Same thing with updating to 0.12.
Steps to reproduce the behavior

Do a backup of a really big folder (~100000 files) locally.
Do you have any idea what may have caused this?
My laptop was lent to me, and is partially controlled, by my employer.
So they may have changed something on it remotely without warning me, but I don't know what.
Do you have an idea how to solve the issue?
No 😕
Did restic help you today? Did it make you happy in any way?

I was searching for a simple portable CLI backup application with deduplication, and restic was exactly what I needed!

What are the symptoms when restic hangs during these commands? Is it just sitting there doing nothing or does restic consume lots of CPU?
Could you try whether restic 0.12.1 helps in any way?
Did I understand correctly that you back up files stored locally into a repository stored locally? How do you run restic (CMD/powershell/msys/?) ?
I'm currently not aware of any recent reports of restic hanging at points in time, especially not across multiple different commands. My first guess would be some anti-virus related issues, but that's nothing more than a hunch. Did you restart the laptop recently (I'm asking because I usually don't restart unless there are updates)?

It does nothing (no CPU use).
Nothing changed with 0.12.1.
Yes, I back up files stored locally into a repository stored locally. I run restic with CMD.
I do restart my laptop regularly (once a day). I recently changed my laptop (with another one from my employer), and the problem is still there. You may be right about the antivirus, do you think restic could give more feedback about what is blocking it?

Hmm, I'm not too familiar with debugging such issues on Windows, maybe someone else has an idea?
Does the verbose backup progress get stuck maybe at a similar file every time?
Besides that a debug build of restic could provide some more insights, see https://github.com/restic/restic/blob/master/CONTRIBUTING.md#reporting-bugs for a short summary of the necessary steps.
Other possibilities I can think of would be trying to get a stack trace using Process Explorer, unfortunately there's no easy way to access the builtin mechanism in Go on windows.

Closing this issue as there is not enough information to investigate.


Difficult to go 'Back' on My Hotspots view.

The placement of the back button makes it difficult to inspect more than one or two hotspots.
I took a quick pass at one solution. I don't think this will be obvious to all users, but this pattern does exist in other apps. (e.g. in the Facebook app, pressing the active button after scrolling will return the user to the top of their feed)
https://www.figma.com/file/ZgcLuizxLDNExuBuF7htj8/Homescreen-Back?node-id=0%3A1

+1
I've hit that nav item a few times expecting it to return me home.


Implement instance generator

Needs tweaking, results are uninteresting.

Does not need to be a module, just a python script suffices, I believe. That said: there's no point in having this. In five days we get the large data set, which obsoletes this module.
(plus, before then, we have to write a presentation and finish the open PRs)

If you disagree do let me know, but I sincerely think this wastes valuable time.


Implement Joiner Router Locator TLV.

Resolves #638.

Current coverage is 65.04% (diff: 0.00%)

Merging #645 into master will decrease coverage by 0.10%

@@             master       #645   diff @@
==========================================
  Files            99         99
  Lines         14338      14351    +13
  Methods        1972       1976     +4
  Messages          0          0
  Branches       1684       1684
==========================================
- Hits           9341       9334     -7
- Misses         4466       4483    +17
- Partials        531        534     +3

Powered by Codecov. Last update 4bd6297...8f60b7c

@chshu, thanks for verifying this PR!