[Pornhub] Youtube-dl grabbing more videos than listed on channel (NSFW)

[x] I've verified and I assure that I'm running youtube-dl 2017.04.17
[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Bug report (encountered problems with youtube-dl)

User has 7 videos uploaded but Youtube-dl repeatedly seen 11, also a different random video ripped at start of every run. The first 4 videos of a channel rip aren't from the target channel (see output below).
youtube-dl -v --ignore-config https://www.pornhub.com/users/mary_mariexxx/videos/public
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--ignore-config', 'https://www.pornhub.com/users/mary_mariexxx/videos/public']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.04.17
[debug] Python version 3.5.2 - Linux-4.4.0-72-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 2.8.11-0ubuntu<IP_ADDRESS>, avprobe 2.8.11-0ubuntu<IP_ADDRESS>, ffmpeg 2.8.11-0ubuntu<IP_ADDRESS>, ffprobe 2.8.11-0ubuntu<IP_ADDRESS>
[debug] Proxy map: {}
[PornHubUserVideos] mary_mariexxx: Downloading page 1
[PornHubUserVideos] mary_mariexxx: Downloading page 2
[download] Downloading playlist: mary_mariexxx
[PornHubUserVideos] playlist mary_mariexxx: Collected 11 video ids (downloading 11 of them)
[download] Downloading video 1 of 11
[PornHub] ph58caae5842f45: Downloading webpage
[PornHub] ph58caae5842f45: Downloading webpage
[debug] Invoking downloader on 'https://bv.phncdn.com/videos/201703/16/109837182/720P_1500K_109837182.mp4?ipa=<IP_ADDRESS>&rs=200&ri=1200&s=1492879829&e=1492887029&h=1b17c01cddf7a7374f17f9fee2d97663'
[download] Resuming download at byte 2349508
[download] Destination: Brazzers - Dirty teen Nicole Bexley loves cock-ph58caae5842f45.mp4
[download] 100% of 86.97MiB in 09:36
[download] Downloading video 2 of 11
[PornHub] ph589b759af1464: Downloading webpage
[PornHub] ph589b759af1464: Downloading webpage
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201702/08/105407102/720P_1500K_105407102.mp4?ttl=1492887609&ri=1228800&rs=1600&hash=4ae872fb816b0105c038a62927237ff8'
[download] Destination: Brazzers - Jillian Janson needs anal-ph589b759af1464.mp4
[download] 100% of 82.11MiB in 07:05
[download] Downloading video 3 of 11
[PornHub]<PHONE_NUMBER>: Downloading webpage
[PornHub]<PHONE_NUMBER>: Downloading webpage
[debug] Invoking downloader on 'https://bv.phncdn.com/videos/201103/07/3043498/vl_480P_303.0k_3043498.mp4?ipa=<IP_ADDRESS>&rs=48&ri=1000&s=1492880837&e=1492888037&h=07e85c321f1f933725a4ca6fe14da4f3'
[download] Destination: young head-1488643063.mp4
[download] 100% of 3.92MiB in 01:00
[download] Downloading video 4 of 11
[PornHub]<PHONE_NUMBER>: Downloading webpage
[PornHub]<PHONE_NUMBER>: Downloading webpage
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201309/19/17554051/vl_480P_595.0k_17554051.mp4?ttl=1492888100&ri=1433600&rs=744&hash=c5340034dbe1461b95a4696897f14616'
[download] Destination: Home Made Blow Jobs 4 - Scene 4-1099822914.mp4
[download] 100% of 56.82MiB in 10:26
[download] Downloading video 5 of 11
[PornHub] ph58ea2d5f11575: Downloading webpage
[PornHub] ph58ea2d5f11575: Downloading webpage
[debug] Invoking downloader on 'https://bv.phncdn.com/videos/201704/09/112601451/720P_1500K_112601451.mp4?ipa=<IP_ADDRESS>&rs=200&ri=2700&s=1492881529&e=1492888729&h=0210c37f5aec14986877da4135a7d1cc'
[download] Destination: Redhead tied up and fucked like a slut-ph58ea2d5f11575.mp4
[download] 100% of 449.40MiB in 38:07
[download] Downloading video 6 of 11
[PornHub] ph58e7be44d0eb2: Downloading webpage
[PornHub] ph58e7be44d0eb2: Downloading webpage
[debug] Invoking downloader on 'https://cv.phncdn.com/videos/201704/07/112409341/720P_1500K_112409341.mp4?a5dcae8e1adc0bdaed975f0d67fb5e0527c20903c5bb57a6cad7e6cb50bc41fbb1152c24e90ee001fb80e2adfff13fd1a9d373ee21fa85533e06d6fa1d5a3ac67c3bdc051991814a43ccb9085902a56cf76826916151ab9bf3c1ce1cf3353601f0569df4e8c69d6093ef443bf7d5c31d29ea1c1d106eb4354445e221'
[download] Destination: Redhead teen getting huge cumshot-ph58e7be44d0eb2.mp4
[download] 100% of 7.23MiB in 00:29
[download] Downloading video 7 of 11
[PornHub] ph58dd6fe73f282: Downloading webpage
[PornHub] ph58dd6fe73f282: Downloading webpage
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201703/30/111567862/720P_1500K_111567862.mp4?ttl=1492891052&ri=1024000&rs=1600&hash=d197d38ce28801b4c71866c5f5cd1a5e'
[download] Destination: Redhead teen deepthroating and gagging on cock-ph58dd6fe73f282.mp4
[download] 100% of 31.09MiB in 02:38
[download] Downloading video 8 of 11
[PornHub] ph58d550a055cc1: Downloading webpage
[PornHub] ph58d550a055cc1: Downloading webpage
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201703/24/110799752/720P_1500K_110799752.mp4?ttl=1492891213&ri=1433600&rs=1600&hash=1c774ae361c7619e4eaa17be84ade58e'
[download] Destination: Redhead Teen Deepthroat-ph58d550a055cc1.mp4
[download] 100% of 116.01MiB in 10:10
[download] Downloading video 9 of 11
[PornHub] ph58d31e5ddb5f8: Downloading webpage
[PornHub] ph58d31e5ddb5f8: Downloading webpage
[debug] Invoking downloader on 'https://cv.phncdn.com/videos/201703/23/110611552/720P_1500K_110611552.mp4?a5dcae8e1adc0bdaed975f0d67fb5e0527c20903c5bb57a6cad7e6cb50bc41fbb1152c24e90ee001fc80e0a9fff13fd3a672d47e8a967bd36ef2c622317ce5fcf4dfd48819930ec53a3dc5c06d721505da9ab502c07273fe3ae57600e23ff6f8ca39e4f28f48189582425c4a1e1f4bfe7e78f7921f31b8fd88202d3d'
[download] Destination: Red Head Teen BDSM-ph58d31e5ddb5f8.mp4
[download] 100% of 54.35MiB in 04:31
[download] Downloading video 10 of 11
[PornHub] ph58d03bdede49d: Downloading webpage
[PornHub] ph58d03bdede49d: Downloading webpage
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201703/20/110342782/720P_1500K_110342782.mp4?ttl=1492892101&ri=1228800&rs=1600&hash=8643cc9561cfc412d9b923d58c2b97fb'
[download] Destination: I love getting sloppy when giving head-ph58d03bdede49d.mp4
[download] 100% of 65.46MiB in 05:38
[download] Downloading video 11 of 11
[PornHub] ph58cd4cec70d16: Downloading webpage
[PornHub] ph58cd4cec70d16: Downloading webpage
[debug] Invoking downloader on 'https://bv.phncdn.com/videos/201703/18/110064742/720P_1500K_110064742.mp4?ipa=<IP_ADDRESS>&rs=200&ri=1200&s=1492885247&e=1492892447&h=3f529e33a97a0b6c0b95083814904f0e'
[download] Destination: My boyfriend tied me up and fucked me like a good little slut-ph58cd4cec70d16.mp4
[download] 100% of 55.09MiB in 04:36
[download] Finished downloading playlist: mary_mariexxx

Problem
PornHubUserVideos downloads 4 extra videos not listed in the user's channel at the beginning of the download process.
Cause
PH sends related videos as part of the user page, but these related videos are never rendered. The extractor finds all strings matching a video page regex in the given webpage.
Solution
Only parse videos in the "videoUList" div by omitting the beginning of the webpage from the extraction process.

Thank you!


chore: update sqs deps to point to sqs/osmosis-main branch

Closes: #XXX
What is the purpose of the change
Pointing to the right branch in the sqs repo per https://github.com/osmosis-labs/sqs/blob/v22.x/CONTRIBUTING.md#branch-management
Documentation and Release Note

[ ] Does this pull request introduce a new feature or user-facing behavior changes?
[ ] Changelog entry added to Unreleased section of CHANGELOG.md?

Where is the change documented?

[ ] Specification (x/{module}/README.md)
[ ] Osmosis documentation site
[ ] Code comments?
[ ] N/A

Note on backports:

backporting to v21.x only where I will manually change the dependencies
v22.x is already manually synched to the right branch here: https://github.com/osmosis-labs/osmosis/pull/7325


How to make the packages

I'm looking at trying to use your script and have a couple questions.
Is the difference between Forced, Self Service, and Classroom is that Forces is for a policy to auto trigger the scripts and start the install, Classroom to be started by a tech on the machine to run without intervention, and Self Service for the end user to start the install when they are prompted.
I see references for the QuickAdd.pkg and the OS installers to all be in the /tmp folder.  How are you getting them there?  Are the separate policies setup to do a Cache install of the app?  Or are they full installs.   Are the packages for each setup to drop the files into /tmp?  Are you just using composer to make these packages?

Hey @Danberms,
Sorry for the delay, I don't get notifications for issues unfortunately.
For the Forced, Self Service, and Classroom options, yes that's the general idea.  However, after testing I do not believe Forced will actually work.
For the packages, yes, you could just use Composer, or any other method to create the packages to drop the files in /tmp.  I have a Policy for each OS Version that "installs" the files to this location.  This script, install_macOS.sh, calls the Policy for the specific OS Version desired via custom event/trigger.
I have plans to revise this script hopefully in the near future, just haven't had time with some other projects I'm working on.


为何web ui 启动失败了

错误详情：
Building prefix dict from the default dictionary ...
DEBUG:jieba:Building prefix dict from the default dictionary ...
Loading model from cache C:\Users\ADMINI~1\AppData\Local\Temp\jieba.cache
DEBUG:jieba:Loading model from cache C:\Users\ADMINI~1\AppData\Local\Temp\jieba.cache
Loading model cost 1.733 seconds.
DEBUG:jieba:Loading model cost 1.733 seconds.
Prefix dict has been built successfully.
DEBUG:jieba:Prefix dict has been built successfully.
Building prefix dict from H:\programs\VITSinference\inference\jieba\dict.txt ...
DEBUG:jieba:Building prefix dict from H:\programs\VITSinference\inference\jieba\dict.txt ...
Loading model from cache C:\Users\ADMINI~1\AppData\Local\Temp\jieba.uc9711501e1872eb81baf472e192ba3fe.cache
DEBUG:jieba:Loading model from cache C:\Users\ADMINI~1\AppData\Local\Temp\jieba.uc9711501e1872eb81baf472e192ba3fe.cache
Loading model cost 1.630 seconds.
DEBUG:jieba:Loading model cost 1.630 seconds.
Prefix dict has been built successfully.
DEBUG:jieba:Prefix dict has been built successfully.
Traceback (most recent call last):
File "inference.py", line 97, in
File "utils.py", line 45, in load_checkpoint
File "torch\nn\modules\module.py", line 1672, in load_state_dict
self.class.name, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for SynthesizerTrn:
size mismatch for enc_p.emb.weight: copying a param with shape torch.Size([52, 192]) from checkpoint, the shape in current model is torch.Size([50, 192]).
[11708] Failed to execute script 'inference' due to unhandled exception!

有人知道是什么原因吗

MoeGoe也差不多，也是无法启动

https://blog.csdn.net/LZL2020LZL/article/details/123502321 不知道行不行 参考一下


Docs

This PR introduces documentation page to iohub.  ~Description will be updated once draft status is removed from PR.~
Please see docs/README.md for usage, right now you can locally build these docs and test. Any feedback is welcome. Should something like this:

I am not totally conviced by pydata-sphinx-theme, would like to take input from more people. Here how it looks  with  light and dark modes:

Here how readthedocs theme looks like for comparison:

pydata theme doesn't build a sidebar from independent toctree elements automatically (but gives more configurability like being able to set independent sidebars for different pages) and I find it less browsable (for a complete doc example I think NumPy is a good one: https://numpy.org/doc/1.24/reference/index.html), so before I invest more time into it, I want to know what is the consensus on preferred theme. Open to new  suggestions as well. Please give input @mattersoflight , @talonchandler , @keithchev , @JoOkuma

I'm mostly agnostic. readthedocs theme looks a bit more readable to me, but using pydata would be consistent w established packages like numpy and zarr, which iohub is obviously closely related to, and this might help establish trust w external users.

A sidebar is indeed useful to navigate and discover documentation. I am happy with any theme that provides sidebar like in numpy docs. The screenshot of the pydata-sphinx-theme GitHub page does show a sidebar.

Hi @AhmetCanSolak do you have a preference/plan for deployment? For example GH pages vs readthedocs, and build workflows.

yes @ziw-liu , I am planning to host on gh pages and already have gh actions tasks to deploy

given https://github.com/pydata/pydata-sphinx-theme/issues/221 I will move with readthedocs theme, I think not sacrificing brows-ability is important to us at this stage.

given pydata/pydata-sphinx-theme#221 I will move with readthedocs theme, I think not sacrificing brows-ability is important to us at this stage.

Thanks for looking into this. For now I'm happy with what gets us to the docs pages the fastest.

@AhmetCanSolak Can the documentation guidelines be added to CONTRIBUTING.md?

Also, just for reference, after merging this PR we will need to make the following changes to the repo settings on github in order to allow the docs workflow to deploy the docs:

under "pages", set the source to "github actions"
under "environments", add a new environment called 'github-pages' and allow the main branch to deploy to it

@AhmetCanSolak Can the documentation guidelines be added to CONTRIBUTING.md?

Just did it.

Hi @AhmetCanSolak how can I locally build the docs and view? Do I need to setup a specific environment for documentation?

addressed Ziwen's comment

Hi @mattersoflight, you can build locally following https://github.com/czbiohub/iohub/pull/28/commits/42670afa7f27cc8c87d48c726ac2ff6c732f99e5.

Hi @AhmetCanSolak how can I locally build the docs and view? Do I need to setup a specific environment for documentation?

here: https://github.com/czbiohub/iohub/pull/28/files#diff-eca12c0a30e25b4b46522ebf89465a03ba72a03f540796c979137931d8f92055

@mattersoflight , I will merge this PR now but please provide your feedback whenever you can. I will make follow  up PRs to address them.


IPN Response error "Invalid form. (for_auction: Enter a number.)" is wrong

The IPN for_auction variable should return only true or false without any numbers (https://developer.paypal.com/docs/classic/ipn/integration-guide/IPNandPDTVariables/#id091EBJ0H0Y4)

The docs don't actually say what is accepted there, but I'll accept your word for it. A patch would be accepted.


linkset paths wrong for ensembl mus musculus

In ensemble mus musculus linkset files there is an inconsistency between what the linkset path is and what the actual path should be.
http://bridgedb.org/data/linksets/MusMusculus/release87
should be
http://bridgedb.org/data/linksets/release87/MusMusculus
'release87' should be before 'MusMusculus'.

Patch put in place, but needs confirmation that the problem is fixed now.


pilot error on macos 12.6.3?

trying the current crusader (just pulled and compiled) on macosx 12.6.3 (intel) against the same version server on ubuntu22 (intel) results in the following issue on the client side:
bash-3.2$ RUST_BACKTRACE=full ./src/target/release/crusader test <IP_ADDRESS>
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 61, kind: ConnectionRefused, message: "Connection refused" }', crusader-lib/src/test.rs:1304:10
stack backtrace:
   0:        0x104364994 - __mh_execute_header
   1:        0x10438008b - __mh_execute_header
   2:        0x10435f208 - __mh_execute_header
   3:        0x104365ebd - __mh_execute_header
   4:        0x104365c14 - __mh_execute_header
   5:        0x1043663f8 - __mh_execute_header
   6:        0x104366333 - __mh_execute_header
   7:        0x104364e17 - __mh_execute_header
   8:        0x10436600a - __mh_execute_header
   9:        0x104394663 - __mh_execute_header
  10:        0x104394755 - __mh_execute_header
  11:        0x1042700fe - __mh_execute_header
  12:        0x1041eaa54 - __mh_execute_header
  13:        0x1041ef446 - __mh_execute_header
Abort trap: 6

the GUI reports error 61 as well, local testing on the client side against a locally started server (from within the GUI) seems to work.
I am pretty sure this is a simple "pilot's error" on my side, but I am at a loss what I am doing wrong here. Any help would be appreciated.

That looks like there's a firewall in place.

Mmmh, thanks. I had disabled the firewall just fine, but I had requested crusader serve --port 30481 which worked in the past, but did result in the client not finding the server anymore. Removing the --port request fixed the issue... as I suspected, pilot error. BTW is there a way to request/use a specific port from the client side?

You can use --port on the CLI from the client, but there isn't currently a GUI option for it.

Thanks! I wonder now whether that ever worked or whether I just misremember this ever actually working.


Fixing some issues in UserTask/TaskQuery

Bool paramters in the TaskQuery class should be nullable, because the affect the results.
Example: WithCandidateGroups and WithoutCandidateGroups are standard false, this will cause the query to return zero UserTask objects.

Thanks for the hint. I didn’t see those functions. You don’t need to merge my fork then, since the changes are only replacing “bool” by “bool?”.
But how do I call them from an UserTaskInfo object, e.g.
            UserTaskInfo uti = await camunda.UserTasks.Get(id);
   uti.Claim(id, user);

Can you please give me a sample how the TaskResource class is supposed to be used?
Von: Jan Lucansky<EMAIL_ADDRESS>Gesendet: Donnerstag, 11. Mai 2017 13:51
An: jlucansky/Camunda.Api.Client
Cc: Dicker Stefan; Author
Betreff: Re: [jlucansky/Camunda.Api.Client] Fixing some issues in UserTask/TaskQuery (#4)
@jlucansky requested changes on this pull request.
Thank you for your contribution, but before I merge, please consider to undo your changes in UserTaskService as you can see these methods are all redundant. Operations related to UserTask are already implemented in TaskResource.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/jlucansky/Camunda.Api.Client/pull/4#pullrequestreview-37553307, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AZfnlLQn2ZD0cxg1sswyo8KL2esBGf0Sks5r4vYIgaJpZM4NQo_f.

Please try this:
await camunda.UserTasks[taskId].Claim(userId); // for claiming

UserTaskInfo uti = await camunda.UserTasks[taskId].Get(); // if you wish full userinfo instance, but is is not necessary for claim

It is not my design this *Resource staff, it is originated from camunda REST implementation.
Anyway, I like your User entity support and other fixes so I just merge it without UserTaskService


Fix compile error introduced in #336

Previous PR #336 was edited using web editor and committed without any checking...
This patch fixes the build, and results are verified.
It seems feature "pattern" of create "regex" are not working on nightly rustc, so I have to remove it from the local build. (Not sure if it needs to be apply to the actually builds as well).
Sorry for the inconvenience.

Seems to be a problem introduced in nightly 1.84.0


feat: Add custom 404 Error Page with styling

feat: Add custom 404 Error Page with styling

Implemented a user-friendly 404 error page to handle broken or non-existent routes.
Added prominent "404" error code and "Page not found" title to guide users.
Included a helpful description to inform users about the missing page.
Designed two primary action buttons: "Go Back" with a rotating arrow icon and "Contact Us" for navigation.
Enhanced the design with a clean, minimal layout using CSS:

Added a subtle gradient background for better visual appeal.
Styled the container with shadow and border-radius for a card-like effect.
Improved button styles with hover effects, smooth transitions, and shadows for modern UI.

Thank you for your contribution! 🎉
Your 404 Error Page implementation has been successfully reviewed and merged.
Summary of Changes:

Custom 404 Error Page with prominent "404" error code, "Page not found" title, and helpful description.
Two action buttons:

Go Back (with rotating arrow icon)
Contact Us for easy navigation.

Enhanced UI with:

Clean, minimal layout.
Subtle gradient background.
Card-like container styling (shadow, border-radius).
Modern button hover effects and smooth transitions.

What We Loved:

User-friendly design: The page is intuitive and clear, helping guide users when they encounter broken links.
Visual aesthetics: The gradient background and card-style container elevate the visual appeal, while the button transitions add a modern touch.
Attention to detail: The rotating arrow icon and clean layout make the page polished and professional.

Thanks again for your valuable contribution to improving the project’s user experience! If you’d like to make any further improvements or contributions, feel free to explore other issues.

feat: Add custom 404 Error Page with styling

Implemented a user-friendly 404 error page to handle broken or non-existent routes.

Added prominent "404" error code and "Page not found" title to guide users.

Included a helpful description to inform users about the missing page.

Designed two primary action buttons: "Go Back" with a rotating arrow icon and "Contact Us" for navigation.

Enhanced the design with a clean, minimal layout using CSS:

Added a subtle gradient background for better visual appeal.
Styled the container with shadow and border-radius for a card-like effect.
Improved button styles with hover effects, smooth transitions, and shadows for modern UI.

Thank you for your contribution! 🎉
Your 404 Error Page implementation has been successfully reviewed and merged.
Summary of Changes:

Custom 404 Error Page with prominent "404" error code, "Page not found" title, and helpful description.
Two action buttons:

Go Back (with rotating arrow icon)
Contact Us for easy navigation.

Enhanced UI with:

Clean, minimal layout.
Subtle gradient background.
Card-like container styling (shadow, border-radius).
Modern button hover effects and smooth transitions.

What We Loved:

User-friendly design: The page is intuitive and clear, helping guide users when they encounter broken links.
Visual aesthetics: The gradient background and card-style container elevate the visual appeal, while the button transitions add a modern touch.
Attention to detail: The rotating arrow icon and clean layout make the page polished and professional.

Thanks again for your valuable contribution to improving the project’s user experience! If you’d like to make any further improvements or contributions, feel free to explore other issues.


JSON Porn

Might be questionable :shipit:, but still, a Free JSON API !

Few downvotes on the API haha, let's leave this one out dude.


Move Flatten and WithFixedSize to interfaces to improve discoverability.

This fixes https://github.com/GoogleCloudPlatform/gcloud-dotnet/issues/157

LGTM


dts: Add missing spi-max-frequency values for mimxrt, nxp, and qemu_riscv2

spi-max-frequency is marked as required in
dts/bindings/mtd/jedec,spi-nor.yaml.
I took the value from the datasheets (133 MHz for all), and guessed that
a dummy entry is fine for QEMU.
Fixes some errors in
https://github.com/zephyrproject-rtos/zephyr/issues/17532.

This could be completely wrong, so please check.

@galak
Fixed. 133 MHz for those too.


Fixed #10 - Component trigger many internet calls

Moved logic (__init__.py) of whether to trigger firmware update before checking state, so state will be able to use the latest update
Wrap the check whether it's time to check firmware update as variable and pass it to the async_get_state of both client.py and client_wax.py
Moved the state request data to consts.py and removed sections FwUpdate and monitor parameter of internetConnectivityStatus
Add IF statement to check if the internet connectivity was not checked since it was loaded or over the last hour, in case it is time to check, add internetConnectivityStatus to monitors
Add IF statement to check if the firmware update function ran, in case it did, will add the FwUpdate section

Tested in local environment, working great.

Amazing! Thank you!

Released in https://github.com/rroller/netgear/releases/tag/0.1.4


versionist: Remove package.json

This is a leftover from 88d6af15d1ee67f13a4cc6fd412426feb07df4df where
the local test versionist files were removed.
Changelog-entry: Remove versionist package.json
Signed-off-by: Alex Gonzalez<EMAIL_ADDRESS>

@balena-ci I self-certify!


Resolve anticipated merge conflict between develop and main

This PR resolves the merge conflict between main and develop that will arise after v1.15.0 is released.
Submission Checklist

[x] Have you installed and run this change against pre-commit? (pre-commit install)
[x] Are all tests passing? (make tests)
[ ] Have you written unit tests to cover this change?
[x] Is unit test coverage still above 80%?
[x] Have you updated all applicable documentation?
[x] Have you followed the guidelines in our Contributing document?

Since this is just an isolated change to develop, can we wait to execute it until we see that there is a merge conflict. Basically, leave this as draft until after release.

Since this is just an isolated change to develop, can we wait to execute it until we see that there is a merge conflict. Basically, leave this as draft until after release.

Yes, that is the plan. Merge #1065 and then observe the merge conflict I anticipate will be resolved by #1066 (this PR).


Confused about the video pairs organization

This is a great work! you said "Then, we randomly select the constructed point cloud of the video frames and render it along the estimated camera trajectory using Pytorch3D." in Sec. 4.1, from my perspective, you want to build some frame pairs in this step right, but one thing that confuses me is, the hole frames are rendered from point cloud, which is constructed from all the frames, so the rendered frames and the real frames are supposed to have very little gap between them? Or you split the frames into two groups, say we have 25 frames, 10 frames are used to build the point cloud with dust3R, then we render the rest 15 frames and combine them with the 15 gt frames to construct the video pairs?

Another question, Next Best View you design is a good strategy to render the next view step by step, I was wondering,  is it possible to obtain the same result by using the adjacent camera and frames aligning with the time line, say right the next frames of the ref images, will this also work?

This is a great work! you said "Then, we randomly select the constructed point cloud of the video frames and render it along the estimated camera trajectory using Pytorch3D." in Sec. 4.1, from my perspective, you want to build some frame pairs in this step right, but one thing that confuses me is, the hole frames are rendered from point cloud, which is constructed from all the frames, so the rendered frames and the real frames are supposed to have very little gap between them? Or you split the frames into two groups, say we have 25 frames, 10 frames are used to build the point cloud with dust3R, then we render the rest 15 frames and combine them with the 15 gt frames to construct the video pairs?

Thanks! We use all 25 frames to build the point cloud with Dust3r, and the rendered frames typically differ from the ground truth frames used for supervision. This allows the model to learn how to refine and correct the rendered frames.

This is a great work! you said "Then, we randomly select the constructed point cloud of the video frames and render it along the estimated camera trajectory using Pytorch3D." in Sec. 4.1, from my perspective, you want to build some frame pairs in this step right, but one thing that confuses me is, the hole frames are rendered from point cloud, which is constructed from all the frames, so the rendered frames and the real frames are supposed to have very little gap between them? Or you split the frames into two groups, say we have 25 frames, 10 frames are used to build the point cloud with dust3R, then we render the rest 15 frames and combine them with the 15 gt frames to construct the video pairs?

Thanks! We use all 25 frames to build the point cloud with Dust3r, and the rendered frames typically differ from the ground truth frames used for supervision. This allows the model to learn how to refine and correct the rendered frames.

Ok, I thought the rendered images had little gap with the gt images. Thank you.

Hi, this was a really great work. While I was trying to implement your code, I wonder how is it possible to render novel views with the predicted camera matrix (4x4) and the focals, instead of using theta, phi, r and so on. Thank you!


[Feature]: Describe how $summary Might Be Used Without Document Sharing Metadata

Contact Details
<EMAIL_ADDRESS>Is your feature request related to a problem? Please describe.
Given that the IPS is a patient level summary, and can be created by invoking the $summary operation, it is possible to exchange an IPS without conventional document sharing actors or working with document sharing objects. This would be done by simply having the Content Consumer invoke the $summary operation of the Content Creator.
Implementations that are FHIR focused, and need only to exchange IPS and not other documents, would likely want to implement this solution, as it is the least complex.
Describe the solution you'd like
$summary should probably be considered an option for sharing the IPS along with the existing document sharing profiles. Linking this to the On-Demand concept and explaining the limitations of $summary (no ability to expand to additional documents) would also be helpful.
Describe alternatives you've considered
No response
Additional context
No response
Code of Conduct

[X] I agree to follow the IHE Code of Conduct

point at the IPS $summary - http://hl7.org/fhir/uv/ips/OperationDefinition-summary.html
try to mention that the XDS on-demand is not the only way to use the $summary; that within other IGs it can be used directly as a FHIR Opertion by a client of that server.


Fix racy per-cpu runtime test

"print_per_cpu_map_vals" is a racy test (and breaking CI) due to the use of a very active probe and per-cpu maps. Let's just use 'BEGIN' to test printing even though this doesn't really exercise the cpu aggregation path as 'BEGIN' only runs on one CPU.
Checklist

[ ] Language changes are updated in man/adoc/bpftrace.adoc
[ ] User-visible and non-trivial changes updated in CHANGELOG.md
[ ] The new behaviour is covered by tests

Do you happen to know what the actual race was? I can't think of anything other than the probe concurrently on different CPUs. Or maybe compiler reordered some statements.
If not, would be good to find out. Maybe it'll reveal something fundamental.

Do you happen to know what the actual race was? I can't think of anything other than the probe concurrently on different CPUs. Or maybe compiler reordered some statements. If not, would be good to find out. Maybe it'll reveal something fundamental.

Discussed a little offline but fairly certain it's just the probe executing on different CPUs while aggregating. If I slow things down (e.g. use a probe that doesn't fire as often like hardware:cache-misses:1000000) then the racy-ness goes away. Also confirmed the probe is running on different cpus.


[Rebuild] New Folders Router, Database and refactoring Api Architecture

New Folders Structure to Router and Database
Modernized code with ESM
New Media Service Class and Router, to manager information from Plex, Jellyfin or another plugin.

looks great, thanks for the pr!


adding some boostrap styles

I'm certainly not web designer. Still, even django-helpdesk seems to be working pretty well sofar, the design could be done much better.
This set of changes introduces some slight bootstrap modifications, which should make the design of some elements slightly "cleaner".
Overall: buttons are smaller, tables are smaller. Headers set where I thought, it makes sense.
Tables are slightly restructure and it should be more easy to get oriented at the first sight.
I hope, you like it, comments are of course welcomed - I assume bigger discussion around this pull request.

tests are ok, except for the one, broken by #733

Thanks!


Removed rotating access logs. Added option to enable access log skipp…

…ing. Added trustProxy options. Made compression configurable. Added options to make cookies configurable

Coverage decreased (-0.1%) to 46.943% when pulling 13ead8b1ff3d78f60bddc7394d5c7178669ce92a on release/0.12.0 into 8a2b1fd077b1a2af7d142b9453d3e57336008f6c on master.


Cleanup should allow removal of  tag

Cleanup should allow wrapping the content before and after the br tag into a different block tag. (Firefox inserts a  tag on enter and user may not want a br tag in their html).

@HarminderSingh1 can you please give more examples of this? We are a little unclear about what the issue is.

I think this is asking for cleanup to convert
ABCDEF
to
ABCDEF
Not that this may not be an issue on Vistaprint’s website as the server side also transforms the html.  If we can allow this [as an options] to happen on the client, the server doesn’t need to do this.


Add .NET MAUI to new issues list

@mairaw looks like this is ready to merge. Any objections if I merge it?

Please go ahead!


Duplicate overall responses by investigator

Subset to RSEVAL=="INVESTIGATOR" & RSTESTCD=="OVRLRESP" and check for duplicate records within:
USUBJID,VISIT,RSCAT,RSSCAT,RSSTRESC
Dont think we have this yet.  @bodachs what do you think?

@bodachs I think current heme studies use just one response assessment criteria (RSCAT) but multiple imaging modalities (RSSCAT).  I noticed in a study duplicate records for a given date but think it might have been a mapping issue that has since been resolved.  So this check seems like itd more be nice to have.


Removed redis pool getter from RedisSessionInterface.

Removed redis pool getter from RedisSessionInterface.
Connection can be established with Sanic's 'before_server_start' listener.
So, as I think, there's no need to get it every request and response.
Usage example:
@app.listener ('before_server_start')
async def setup_sanic_session (app, loop):
    redis_pool = await await asyncio_redis.Pool.create(host='<IP_ADDRESS>', port=6379,  poolsize=2)
    packages.sanic_session.install_middleware (app, 'RedisSessionInterface', redis_pool)

@vlad1777d Thank you for your effort. Idea was implemented little different way. So I will close this one.


Update Blazor Call .NET from JS + fix a regression

Fixes #19732
Thanks @mrlife! 🎷
It was better BEFORE I touched it this weekend. 🙈
I'll work on this topic further when I have more time, which will be after .NET 5 releases. The holiday period between Thanksgiving 🦃 and mid-December looks good for a major update with improved organization and with better and more examples.

@mrlife ... I'm not sure exactly how engineering will want it in the end. On this PR, I've converted it back to what it was with the app assembly name as the identifier. This is the way that it was originally approved for publication. Truly tho as you say, it seems to run fine either way. It can be done this way ...
[JSInvokable]
public void UpdateMessageCaller()
{
    action.Invoke();
}

... with ...
window.updateMessageCallerJS = (dotnetHelper) => {
    dotnetHelper.invokeMethodAsync('UpdateMessageCaller');
    dotnetHelper.dispose();
};

-- or it can be done this way ...
[JSInvokable("{APP ASSEMBLY IDENTIFIER HERE}")]
public void UpdateMessageCaller()
{
    action.Invoke();
}

... with ...
window.updateMessageCallerJS = (dotnetHelper) => {
    dotnetHelper.invokeMethodAsync('{APP ASSEMBLY IDENTIFIER HERE}', 'UpdateMessageCaller');
    dotnetHelper.dispose();
};

Since they approved the latter approach, let's stick with that right now. I'll inquire with them on this when I get back to this topic later this year. I'll cross-ref this comment on my tracking issue.


Unable to push packet on pub.dartlang.org

Error message I get is
UnauthorizedAccess: Unauthorized user<EMAIL_ADDRESS>is not allowed to upload versions to package redis..

While trying to upload redis package
https://pub.dartlang.org/packages/redis
I suspect it has something to do with email being capital. (at author -><EMAIL_ADDRESS>but for uploaded is<EMAIL_ADDRESS>)
Since last upload I think I have replaced dart binaries so it is possible that bug is there (in pub)

Thank you for the report.
This is an issue for  https://github.com/dart-lang/pub-dartlang-dart and has been fixed.


Create virtual environment: command not found

During the installation process, entering virtualenv -p /usr/bin/python butterflow results in -bash: virtualenv: command not found.
Additionally, brew install homebrew/science/opencv --with-ffmpeg yields the error message Error: invalid option: --with-ffmpeg.

The build instructions are outdated. Assume no support on macOS at this point.


make verify-codegen is failing on the master branch

Is this a BUG REPORT or FEATURE REQUEST?:
BUG REPORT
What happened:
I've just created a Pull Request, but the make verify-codegen target is failing due to the following error:
./hack/verify-codegen.sh
Generating deepcopy funcs
Generating clientset for workflow:v1alpha1 at github.com/argoproj/argo/pkg/client/clientset
Generating listers for workflow:v1alpha1 at github.com/argoproj/argo/pkg/client/listers
Generating informers for workflow:v1alpha1 at github.com/argoproj/argo/pkg/client/informers
diffing ./hack/../pkg against freshly generated codegen
./hack/../pkg up to date.
./hack/update-openapigen.sh --verify-only
mkdir -p /home/ian/gocode/src/github.com/argoproj/argo/dist
go run ./hack/gen-openapi-spec/main.go 2.4.0 > /home/ian/gocode/src/github.com/argoproj/argo/dist/swagger.json
diff /home/ian/gocode/src/github.com/argoproj/argo/dist/swagger.json /home/ian/gocode/src/github.com/argoproj/argo/api/openapi-spec/swagger.json
5c5
<     "version": "v2.4.0"
---
>     "version": "v2.3.0-rc3"
Makefile:146: recipe for target 'verify-codegen' failed
make: *** [verify-codegen] Error 1

I thought this looked strange, since my change shouldn't have broken in that way, so I rolled back the change and reran make verify-codegen from the tip of master. Sure enough, the target is still failing. This prevents any future PR's from passing the checks.
How to reproduce it (as minimally and precisely as possible):
clone argo and run make verify-codegen.
Environment:

Argo version:

$ ./dist/argo version
argo: v2.4.0+270aabf.dirty
  BuildDate: 2019-06-05T20:53:26Z
  GitCommit: 270aabf1d8cabd69b9851209ad5d9c874348e21d
  GitTreeState: clean
  GoVersion: go1.12
  Compiler: gc
  Platform: linux/amd64

Fixed


How do you refresh?

BH
In three portal you have the option to edit yml.
However saving new yml in its place doesn't seem to have any effect. Even restarting the service doesn't change the configuration.
What I am looking for is something that would re-run the docker-compose up (possibly preceded by docker-compose down)
The only thing i can do is delete the webservice and recreate it

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b2472d79-baad-f202-75dc-c0d7c08e5c49
Version Independent ID: 7816cf1e-2264-e365-4d5c-b1fc9f7d08fe
Content: Create multi-container app in Web App for Containers - Azure App Service
Content Source: articles/app-service/containers/tutorial-multi-container-app.md
Service: app-service
GitHub Login: @msangapu
Microsoft Alias: msangapu

@jewpaltz Thanks for the feedback! We are currently investigating and will update you shortly.

Hi @jewpaltz my apologies. I'm a developer too so my intent on providing the gif was to get the CLI commands I thought were needed to set your container app service for continuous deployment in order to update images.
In your app, click container settings, that will open the blade which will allow your to upload your changed docker-compose.yml file. You can verify that it's been changed in https://wawsobserver.azurewebsites.windows.net/

One more thing, if you have access to the portal, then you have access to the CLI. Another tool you can add to your toolbox; I've found it best to install it using chocolatey.
choco install azure-cli

@RyanHill-MSFT Thank you very much
That link that you provided seams to be a Microsoft corporate website. Regular customers like myself don't have access to it.
But I can verify that is hasn't been changed by looking at the logs and the running service.
When you change the yml in the blade it **does not ** take effect.
That is what my question was!!!

@jewpaltz, shoot us an email at azcommunity[at]microsoft[dot]com ATTN: Ryan along with your subscription id. This should be working but the fact it isn't is indicative of some underlying issue.

@jewpaltz, Since we will work with you offline, we will now proceed to close this thread in anticipation for your email.


[Bug] Page does not correctly refresh to Step3

Summary
I followed the steps until the end of step 2 and refreshed the page as specified, but the ReadMe does not update to step 3
How to reproduce

Follow the instructions including activity "step 2: Push code to your repository from the codespace"
Wait the 60 seconds as given by the instructions
Refresh
Nothing happens, ReadMe still displays "step 2", I've reloaded multiple times and waited far longer than a minute.

Additional context
Screenshot of the state of my repository (including the skill.js file pushed)

Name the file skills.js, not skill.js.


a problem with unicode in file names

Hello,
I encountered the following bug:

I have an empty local directory test and an empty directory test on an sftp server backup.
Locally I create a file:

touch test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxà

The name contains 198 (not less) letters "x" (normal ascii x) and the
something utf-8, here à is '0xc3 0xa0'.
3. Run sftpclone test/ backup:/test.  Everything is OK, the file copied to
the server.
4. Run the same command again.  The result:
Traceback (most recent call last):
  File "/usr/bin/sftpclone", line 7, in <module>
    sftpclone()
  File "/usr/lib64/python2.7/site-packages/sftpclone/sftpclone.py", line 746, in main
    sync.run()
  File "/usr/lib64/python2.7/site-packages/sftpclone/sftpclone.py", line 563, in run
    self.check_for_deletion()
  File "/usr/lib64/python2.7/site-packages/sftpclone/sftpclone.py", line 388, in check_for_deletion
    for remote_st in self.sftp.listdir_attr(remote_path):
  File "/usr/lib64/python2.7/site-packages/paramiko/sftp_client.py", line 209, in listdir_attr
    longname = msg.get_text()
  File "/usr/lib64/python2.7/site-packages/paramiko/message.py", line 186, in get_text
    return u(self.get_bytes(self.get_int()))
  File "/usr/lib64/python2.7/site-packages/paramiko/py3compat.py", line 53, in u
    return s.decode(encoding)
  File "/usr/lib64/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 253: unexpected end of data

The same happens for any other utf-8 symbol, always "codec can't decode" the first byte "in position 253".

Interesting, I'll look into it.
I assume you're running last PyPi version, right? And on what Python version?

Yes, version 1.1, python 2.7.5. Thank you!

Well, this is weird, I can't reproduce it.
I tried both manually, as you did, and both with a custom test (5f5cee67476aca90903f3ca45915ed9d609d22c7), on Python 3.5.1 and 2.7.10.
Could you please try running the latest tests?
python setup.py test from the cloned repository should be enough.

I'm sorry, I've no python experience. So, I run
git clone https://github.com/unbit/sftpclone

and then python setup.py test. Errors seem not related to utf-8:
~/sftpclone$ python setup.py test
running test
Searching for nose
Reading https://pypi.python.org/simple/nose/
Best match: nose 1.3.7
Downloading https://pypi.python.org/packages/source/n/nose/nose-1.3.7.tar.gz#md5=4d3ad0ff07b61373d2cefc89c5d0b20b
Processing nose-1.3.7.tar.gz
Writing /tmp/easy_install-ZcA4X0/nose-1.3.7/setup.cfg
Running nose-1.3.7/setup.py -q bdist_egg --dist-dir /tmp/easy_install-ZcA4X0/nose-1.3.7/egg-dist-tmp-6fY6Zs
no previously-included directories found matching 'doc/.build'
creating /home/alik/sftpclone/.eggs/nose-1.3.7-py2.7.egg
Extracting nose-1.3.7-py2.7.egg to /home/alik/sftpclone/.eggs

Installed /home/alik/sftpclone/.eggs/nose-1.3.7-py2.7.egg
running egg_info
creating sftpclone.egg-info
writing requirements to sftpclone.egg-info/requires.txt
writing sftpclone.egg-info/PKG-INFO
writing top-level names to sftpclone.egg-info/top_level.txt
writing dependency_links to sftpclone.egg-info/dependency_links.txt
writing manifest file 'sftpclone.egg-info/SOURCES.txt'
reading manifest file 'sftpclone.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'sftpclone.egg-info/SOURCES.txt'
running build_ext
sftpclone.t.test_sftpclone.test_cli_args
Test CLI arguments. ... 2015-12-15 19:03:40,224 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,414 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,414 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,609 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,609 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,609 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,692 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,692 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,692 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
2015-12-15 19:03:40,692 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/alik/.ssh/config'. Trying to continue anyway...
ok
sftpclone.t.test_sftpclone.test_remote_tilde_home
Test tilde expansion on remote end. ... ok
sftpclone.t.test_sftpclone.test_ssh_agent_failure
Test ssh_agent failure with bad keys (default). ... ERROR
sftpclone.t.test_sftpclone.test_relative_link_to_inner_dir
Test creation of a relative link to a subnode of the tree. ... ok
sftpclone.t.test_sftpclone.test_already_relative_link_to_inner_dir
Test creation of a relative link (that already exists) to a subnode of the tree. ... ok
sftpclone.t.test_sftpclone.test_exclude
Test pattern exclusion handling. ... ok
sftpclone.t.test_sftpclone.test_inner_exclude
Test pattern exclusion (with recursion) handling. ... ok
sftpclone.t.test_sftpclone.test_local_relative_link
Test relative links creation/update (cases C/D). ... ok
sftpclone.t.test_sftpclone.test_local_absolute_link
Test absolute links creation/update (cases A/B). ... ok
sftpclone.t.test_sftpclone.test_orphaned_remote_symlink
Test deletion of orphaned remote links (not existing in local folder). ... ok
sftpclone.t.test_sftpclone.test_directory_upload
Test upload/creation of whole directory trees. ... ok
sftpclone.t.test_sftpclone.test_file_upload
Test upload/creation of files. ... ok
sftpclone.t.test_sftpclone.test_remote_but_not_local_files
Test deletion of files (when needed). ... ok
sftpclone.t.test_sftpclone.test_remote_but_not_local_directories
Test deletion of directories (when needed). ... ok
sftpclone.t.test_sftpclone.test_remote_dot_not_delete
Test do not delete missing local files on remote end. ... ok
sftpclone.t.test_sftpclone.test_handle_unicode_files
Test handling unicode files. ... ok
sftpclone.t.test_sftpclone.test_long_unicode_file
Test handling long unicode file-names. ... ok

======================================================================
ERROR: sftpclone.t.test_sftpclone.test_ssh_agent_failure
Test ssh_agent failure with bad keys (default).
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/alik/sftpclone/.eggs/nose-1.3.7-py2.7.egg/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/home/alik/sftpclone/.eggs/nose-1.3.7-py2.7.egg/nose/tools/nontrivial.py", line 60, in newfunc
    func(*arg, **kw)
  File "/home/alik/sftpclone/sftpclone/t/test_sftpclone.py", line 317, in test_ssh_agent_failure
    _sync(ssh_agent=True)
  File "/home/alik/sftpclone/sftpclone/t/test_sftpclone.py", line 155, in _sync
    delete=delete
  File "/home/alik/sftpclone/sftpclone/sftpclone.py", line 146, in __init__
    agent_keys.append(*agent.get_keys())
TypeError: append() takes exactly one argument (0 given)

----------------------------------------------------------------------
Ran 17 tests in 3.970s

FAILED (errors=1)
~/sftpclone$

Essential news.
I repeated my experiment with only one change, different sftp server, and no error!  The server which gives the error is the [Hetzner] (https://www.hetzner.de/) backup server (described [here] (http://wiki.hetzner.de/index.php/Backup/en)). The one which works is a usual openssh.

OK so, for the first error, don't worry about it, the important test is passing and I'll fix the other (unrelated).
For the news instead, perfect I'll get access to a server and investigate more.

OK so I managed to get access to a server, but I can't reproduce.
My environment is as follows.
The local test directory.
$ tree .
.
├── test_test
│   └── xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxa�\200
└── xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxa�\200

Relevant shell locale variables:
LC_ALL=en_US.UTF-8
LANG=en_US.UTF-8

On the remote side, I only created a test directory to hold the backups.
I launch sftpclone twice and get no error (command follows). Any idea?
$ sftpclone ~/test [remote_server]:~/test

My tree looks different:
$ tree .
.
└── test
    └── xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxà

with "à" at the very end.
My environment is:
$  env | grep "LC\|LANG"
LC_MONETARY=en_US.UTF-8
LC_NUMERIC=en_US.UTF-8
LC_MESSAGES=en_US.UTF-8
LANG=ru_RU.UTF-8
LC_TIME=en_GB.UTF-8

I tried to set everything to en_US.UTF-8, but this changed nothing.

Yeah sorry, it's an "à" but for whatever reason tree displays it as a�\200 while ls displays it correctly:
$ ls -R .
test

./test:
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxà

$ tree .
.
└── test
    └── xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxa�\200

1 directory, 1 file

Only to be sure that you're using the latest version (we had problems with unicode before), can you do the following steps? Better inside a virtualenv, so to keep your system clean.
$ git clone https://github.com/unbit/sftpclone
$ cd sftpclone
$ python setup.py develop
$ which sftpclone
$ # try again launching the backup

I did the test in a virtualenv, $ which sftpclone shows:
/home/slalik/testenv/bin/sftpclone, but the result is exactly the same.

OK let's keep digging then.
Can you please try using the -l DEBUG flag and posting the full log?

Here you are:
test1.txt
test2.txt

Small news: I can understand why I can't reproduce it.
Even if I create the file as follows:
touch $(echo -en "test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xC3\xA0")

When I go through the log I see it listed as:
'/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxa\xcc\x80'

So there is something in the middle (probably my shell) that changes the name.
I'll investigate more.

OK, I finally managed to reproduce. I couldn't reproduce it on a OS X file system because it uses, by default, utf-8 encoding, where Linux doesn't (and this will be important next).
First thing, I created the test directory:
aldur@aldurs-raspberrypi: ~ $ export LANG="en_US.UTF-8"; export LC_ALL="en_US.UTF-8";
aldur@aldurs-raspberrypi: ~ $ env | grep LC
LC_ALL=en_US.UTF-8
aldur@aldurs-raspberrypi: ~ $ mkdir test
aldur@aldurs-raspberrypi: ~ $ cd test
aldur@aldurs-raspberrypi: ~/test $ touch xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxà
aldur@aldurs-raspberrypi: ~/test $ tree .
.
└── xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxà

0 directories, 1 file

Those steps, as you saw earlier, on OS X created a file with a differently encoded name. That's why I couldn't reproduce.
On the remote side, I manually created the empty test directory.
Then I launched sftpclone the first time and everything went fine:
(sftpclone) aldur@aldurs-raspberrypi: ~ $ sftpclone -l DEBUG ~/test [redacted]:[redacted]@[redacted]:/test
2016-02-09 16:10:47,963 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/aldur/.ssh/config'. Trying to continue anyway...
2016-02-09 16:10:48,251 - DEBUG - starting thread (client mode): 0xb6a88910L
2016-02-09 16:10:48,257 - DEBUG - Local version/idstring: SSH-2.0-paramiko_1.16.0
2016-02-09 16:10:48,263 - DEBUG - Remote version/idstring: SSH-2.0-mod_sftp/0.9.9
2016-02-09 16:10:48,268 - INFO - Connected (version 2.0, client mod_sftp/0.9.9)
2016-02-09 16:10:48,288 - DEBUG - kex algos:[u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group-exchange-sha1', u'diffie-hellman-group14-sha1', u'diffie-hellman-group1-sha1', u'rsa1024-sha1'] server key:[u'ssh-rsa', u'ssh-dss'] client encrypt:[u'aes256-ctr', u'aes192-ctr', u'aes128-ctr', u'aes256-cbc', u'aes192-cbc', u'aes128-cbc', u'blowfish-ctr', u'blowfish-cbc', u'cast128-cbc', u'arcfour256', u'arcfour128', u'3des-ctr', u'3des-cbc'] server encrypt:[u'aes256-ctr', u'aes192-ctr', u'aes128-ctr', u'aes256-cbc', u'aes192-cbc', u'aes128-cbc', u'blowfish-ctr', u'blowfish-cbc', u'cast128-cbc', u'arcfour256', u'arcfour128', u'3des-ctr', u'3des-cbc'] client mac:[u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1', u'hmac-sha1-96', u'hmac-md5', u'hmac-md5-96', u'hmac-ripemd160'<EMAIL_ADDRESS>server mac:[u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1', u'hmac-sha1-96', u'hmac-md5', u'hmac-md5-96', u'hmac-ripemd160'<EMAIL_ADDRESS>client compress:[u'none'] server compress:[u'none'] client lang:[u''] server lang:[u''] kex follows?False
2016-02-09 16:10:48,294 - DEBUG - Kex agreed: diffie-hellman-group1-sha1
2016-02-09 16:10:48,301 - DEBUG - Cipher agreed: aes128-ctr
2016-02-09 16:10:48,306 - DEBUG - MAC agreed: hmac-sha2-256
2016-02-09 16:10:48,311 - DEBUG - Compression agreed: none
2016-02-09 16:10:49,237 - DEBUG - kex engine KexGroup1 specified hash_algo <built-in function openssl_sha1>
2016-02-09 16:10:49,306 - DEBUG - Switch to new keys ...
2016-02-09 16:10:49,446 - DEBUG - userauth is OK
2016-02-09 16:10:49,517 - INFO - Authentication (password) successful!
2016-02-09 16:10:49,549 - DEBUG - [chan 0] Max packet in: 32768 bytes
2016-02-09 16:10:49,609 - DEBUG - [chan 0] Max packet out: 32768 bytes
2016-02-09 16:10:49,617 - DEBUG - Secsh channel 0 opened.
2016-02-09 16:10:49,682 - DEBUG - [chan 0] Sesch channel 0 request ok
2016-02-09 16:10:49,753 - INFO - [chan 0] Opened sftp connection (server version 3)
2016-02-09 16:10:49,768 - DEBUG - [chan 0] listdir('/test/')
2016-02-09 16:10:50,074 - DEBUG - [chan 0] lstat('/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0')
2016-02-09 16:10:50,152 - DEBUG - [chan 0] open('/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0', 'wb')
2016-02-09 16:10:50,241 - DEBUG - [chan 0] open('/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0', 'wb') -><PHONE_NUMBER>6632303232616532366563
2016-02-09 16:10:50,247 - DEBUG - [chan 0] close(63303730346632303232616532366563)
2016-02-09 16:10:50,339 - DEBUG - [chan 0] stat('/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0')
2016-02-09 16:10:50,431 - DEBUG - [chan 0] chmod('/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0', 420)
2016-02-09 16:10:50,511 - DEBUG - [chan 0] utime('/test/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0',<PHONE_NUMBER>.7462077,<PHONE_NUMBER>.7462077))

Then, I launched it the second time and here is the crash.
(sftpclone) aldur@aldurs-raspberrypi: ~ $ sftpclone -l DEBUG ~/test [redacted]:[redacted]@[redacted]:/test
2016-02-09 16:12:13,823 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/aldur/.ssh/config'. Trying to continue anyway...
2016-02-09 16:12:14,451 - DEBUG - starting thread (client mode): 0xb6a83910L
2016-02-09 16:12:14,466 - DEBUG - Local version/idstring: SSH-2.0-paramiko_1.16.0
2016-02-09 16:12:14,477 - DEBUG - Remote version/idstring: SSH-2.0-mod_sftp/0.9.9
2016-02-09 16:12:14,489 - INFO - Connected (version 2.0, client mod_sftp/0.9.9)
2016-02-09 16:12:14,522 - DEBUG - kex algos:[u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group-exchange-sha1', u'diffie-hellman-group14-sha1', u'diffie-hellman-group1-sha1', u'rsa1024-sha1'] server key:[u'ssh-rsa', u'ssh-dss'] client encrypt:[u'aes256-ctr', u'aes192-ctr', u'aes128-ctr', u'aes256-cbc', u'aes192-cbc', u'aes128-cbc', u'blowfish-ctr', u'blowfish-cbc', u'cast128-cbc', u'arcfour256', u'arcfour128', u'3des-ctr', u'3des-cbc'] server encrypt:[u'aes256-ctr', u'aes192-ctr', u'aes128-ctr', u'aes256-cbc', u'aes192-cbc', u'aes128-cbc', u'blowfish-ctr', u'blowfish-cbc', u'cast128-cbc', u'arcfour256', u'arcfour128', u'3des-ctr', u'3des-cbc'] client mac:[u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1', u'hmac-sha1-96', u'hmac-md5', u'hmac-md5-96', u'hmac-ripemd160'<EMAIL_ADDRESS>server mac:[u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1', u'hmac-sha1-96', u'hmac-md5', u'hmac-md5-96', u'hmac-ripemd160'<EMAIL_ADDRESS>client compress:[u'none'] server compress:[u'none'] client lang:[u''] server lang:[u''] kex follows?False
2016-02-09 16:12:14,528 - DEBUG - Kex agreed: diffie-hellman-group1-sha1
2016-02-09 16:12:14,535 - DEBUG - Cipher agreed: aes128-ctr
2016-02-09 16:12:14,544 - DEBUG - MAC agreed: hmac-sha2-256
2016-02-09 16:12:14,549 - DEBUG - Compression agreed: none
2016-02-09 16:12:16,262 - DEBUG - kex engine KexGroup1 specified hash_algo <built-in function openssl_sha1>
2016-02-09 16:12:16,310 - DEBUG - Switch to new keys ...
2016-02-09 16:12:16,465 - DEBUG - userauth is OK
2016-02-09 16:12:16,541 - INFO - Authentication (password) successful!
2016-02-09 16:12:16,598 - DEBUG - [chan 0] Max packet in: 32768 bytes
2016-02-09 16:12:16,666 - DEBUG - [chan 0] Max packet out: 32768 bytes
2016-02-09 16:12:16,676 - DEBUG - Secsh channel 0 opened.
2016-02-09 16:12:16,789 - DEBUG - [chan 0] Sesch channel 0 request ok
2016-02-09 16:12:16,859 - INFO - [chan 0] Opened sftp connection (server version 3)
2016-02-09 16:12:16,881 - DEBUG - [chan 0] listdir('/test/')
Traceback (most recent call last):
  File "/home/aldur/.virtualenvs/sftpclone/bin/sftpclone", line 6, in <module>
    exec(compile(open(__file__).read(), __file__, 'exec'))
  File "/home/aldur/sftpclone/bin/sftpclone", line 7, in <module>
    sftpclone()
  File "/home/aldur/sftpclone/sftpclone/sftpclone.py", line 746, in main
    sync.run()
  File "/home/aldur/sftpclone/sftpclone/sftpclone.py", line 564, in run
    self.check_for_deletion()
  File "/home/aldur/sftpclone/sftpclone/sftpclone.py", line 389, in check_for_deletion
    for remote_st in self.sftp.listdir_attr(remote_path):
  File "build/bdist.linux-armv6l/egg/paramiko/sftp_client.py", line 209, in listdir_attr
  File "build/bdist.linux-armv6l/egg/paramiko/message.py", line 186, in get_text
  File "build/bdist.linux-armv6l/egg/paramiko/py3compat.py", line 53, in u
  File "/home/aldur/.virtualenvs/sftpclone/lib/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 253: unexpected end of data
2016-02-09 16:12:17,166 - DEBUG - EOF in transport thread

The thing is that I don't believe this is an sftpclone bug;
look at the following session, the crash still occurs by simply using Paramiko's naked calls.
It also seems to occur regardless of the result of the call python -c "import sys; print(sys.getfilesystemencoding())", because Paramiko always tries converting to UTF-8.
(sftpclone) aldur@aldurs-raspberrypi: ~ $ python
Python 2.7.11 (default, Dec 11 2015, 05:34:28)
[GCC 5.3.0] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import paramiko
>>> transport = paramiko.Transport(('[redacted]', [redacted]))
>>> transport.start_client()
>>> transport.auth_password(username='[redacted]', password='[redacted]')
[]
>>> sftp = paramiko.SFTPClient.from_transport(transport)
>>> print(sftp.listdir_attr('test'))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "build/bdist.linux-armv6l/egg/paramiko/sftp_client.py", line 209, in listdir_attr
  File "build/bdist.linux-armv6l/egg/paramiko/message.py", line 186, in get_text
  File "build/bdist.linux-armv6l/egg/paramiko/py3compat.py", line 53, in u
  File "/home/aldur/.virtualenvs/sftpclone/lib/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 253: unexpected end of data
>>>

As further investigations have shown, the issue only appears against the Hetzner backup servers.
Indeed, the same tests (shown below) performed against the localhost server didn't fail.
(sftpclone) aldur@aldurs-raspberrypi: ~ $ sftpclone -a -l DEBUG ~/test localhost:~/test_bis
2016-02-09 16:26:14,647 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/aldur/.ssh/config'. Trying to continue anyway...
2016-02-09 16:26:14,977 - DEBUG - starting thread (client mode): 0xb6084cd0L
2016-02-09 16:26:14,990 - DEBUG - Local version/idstring: SSH-2.0-paramiko_1.16.0
2016-02-09 16:26:15,003 - DEBUG - Remote version/idstring: SSH-2.0-OpenSSH_7.1
2016-02-09 16:26:15,008 - INFO - Connected (version 2.0, client OpenSSH_7.1)
2016-02-09 16:26:15,057 - DEBUG - kex<EMAIL_ADDRESS>u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group14-sha1'] server key:[u'ssh-rsa', u'ecdsa-sha2-nistp256', u'ssh-ed25519'] client<EMAIL_ADDRESS>u'aes128-ctr', u'aes192-ctr', u'aes256-ctr'<EMAIL_ADDRESS><EMAIL_ADDRESS>server<EMAIL_ADDRESS>u'aes128-ctr', u'aes192-ctr', u'aes256-ctr'<EMAIL_ADDRESS><EMAIL_ADDRESS>client<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] server<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] client compress:[u'none'<EMAIL_ADDRESS>server compress:[u'none'<EMAIL_ADDRESS>client lang:[u''] server lang:[u''] kex follows?False
2016-02-09 16:26:15,077 - DEBUG - Kex agreed: diffie-hellman-group14-sha1
2016-02-09 16:26:15,101 - DEBUG - Cipher agreed: aes128-ctr
2016-02-09 16:26:15,111 - DEBUG - MAC agreed: hmac-sha2-256
2016-02-09 16:26:15,123 - DEBUG - Compression agreed: none
2016-02-09 16:26:28,642 - DEBUG - kex engine KexGroup14 specified hash_algo <built-in function openssl_sha1>
2016-02-09 16:26:28,663 - DEBUG - Switch to new keys ...
2016-02-09 16:26:28,718 - DEBUG - userauth is OK
2016-02-09 16:26:28,801 - INFO - Authentication (publickey) successful!
2016-02-09 16:26:28,836 - DEBUG - [chan 0] Max packet in: 32768 bytes
2016-02-09 16:26:28,954 - DEBUG - Received global request<EMAIL_ADDRESS>2016-02-09 16:26:28,957 - DEBUG - Rejecting<EMAIL_ADDRESS>global request from server.
2016-02-09 16:26:28,966 - DEBUG - [chan 0] Max packet out: 32768 bytes
2016-02-09 16:26:28,971 - DEBUG - Secsh channel 0 opened.
2016-02-09 16:26:29,012 - DEBUG - [chan 0] Sesch channel 0 request ok
2016-02-09 16:26:29,046 - INFO - [chan 0] Opened sftp connection (server version 3)
2016-02-09 16:26:29,055 - DEBUG - [chan 0] stat('.')
2016-02-09 16:26:29,071 - DEBUG - [chan 0] normalize('.')
2016-02-09 16:26:29,088 - DEBUG - [chan 0] listdir('/home/aldur/test_bis/')
2016-02-09 16:26:29,274 - DEBUG - [chan 0] lstat('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0')
2016-02-09 16:26:29,304 - DEBUG - [chan 0] open('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0', 'wb')
2016-02-09 16:26:29,345 - DEBUG - [chan 0] open('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0', 'wb') -> 00000000
2016-02-09 16:26:29,366 - DEBUG - [chan 0] close(00000000)
2016-02-09 16:26:29,400 - DEBUG - [chan 0] stat('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0')
2016-02-09 16:26:29,461 - DEBUG - [chan 0] chmod('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0', 420)
2016-02-09 16:26:29,515 - DEBUG - [chan 0] utime('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0',<PHONE_NUMBER>.7462077,<PHONE_NUMBER>.7462077))
(sftpclone) aldur@aldurs-raspberrypi: ~ $ sftpclone -a -l DEBUG ~/test localhost:~/test_bis
2016-02-09 16:26:39,683 - ERROR - Error while parsing ssh_config file: [Errno 2] No such file or directory: '/home/aldur/.ssh/config'. Trying to continue anyway...
2016-02-09 16:26:39,921 - DEBUG - starting thread (client mode): 0xb5fb1cd0L
2016-02-09 16:26:39,931 - DEBUG - Local version/idstring: SSH-2.0-paramiko_1.16.0
2016-02-09 16:26:39,941 - DEBUG - Remote version/idstring: SSH-2.0-OpenSSH_7.1
2016-02-09 16:26:39,945 - INFO - Connected (version 2.0, client OpenSSH_7.1)
2016-02-09 16:26:39,978 - DEBUG - kex<EMAIL_ADDRESS>u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group14-sha1'] server key:[u'ssh-rsa', u'ecdsa-sha2-nistp256', u'ssh-ed25519'] client<EMAIL_ADDRESS>u'aes128-ctr', u'aes192-ctr', u'aes256-ctr'<EMAIL_ADDRESS><EMAIL_ADDRESS>server<EMAIL_ADDRESS>u'aes128-ctr', u'aes192-ctr', u'aes256-ctr'<EMAIL_ADDRESS><EMAIL_ADDRESS>client<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] server<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] client compress:[u'none'<EMAIL_ADDRESS>server compress:[u'none'<EMAIL_ADDRESS>client lang:[u''] server lang:[u''] kex follows?False
2016-02-09 16:26:39,995 - DEBUG - Kex agreed: diffie-hellman-group14-sha1
2016-02-09 16:26:40,004 - DEBUG - Cipher agreed: aes128-ctr
2016-02-09 16:26:40,013 - DEBUG - MAC agreed: hmac-sha2-256
2016-02-09 16:26:40,032 - DEBUG - Compression agreed: none
2016-02-09 16:26:52,520 - DEBUG - kex engine KexGroup14 specified hash_algo <built-in function openssl_sha1>
2016-02-09 16:26:52,540 - DEBUG - Switch to new keys ...
2016-02-09 16:26:52,583 - DEBUG - userauth is OK
2016-02-09 16:26:52,727 - INFO - Authentication (publickey) successful!
2016-02-09 16:26:52,757 - DEBUG - [chan 0] Max packet in: 32768 bytes
2016-02-09 16:26:52,866 - DEBUG - Received global request<EMAIL_ADDRESS>2016-02-09 16:26:52,872 - DEBUG - Rejecting<EMAIL_ADDRESS>global request from server.
2016-02-09 16:26:52,881 - DEBUG - [chan 0] Max packet out: 32768 bytes
2016-02-09 16:26:52,885 - DEBUG - Secsh channel 0 opened.
2016-02-09 16:26:52,919 - DEBUG - [chan 0] Sesch channel 0 request ok
2016-02-09 16:26:52,962 - INFO - [chan 0] Opened sftp connection (server version 3)
2016-02-09 16:26:52,970 - DEBUG - [chan 0] stat('.')
2016-02-09 16:26:52,987 - DEBUG - [chan 0] normalize('.')
2016-02-09 16:26:53,005 - DEBUG - [chan 0] listdir('/home/aldur/test_bis/')
2016-02-09 16:26:53,060 - DEBUG - [chan 0] lstat('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0')
2016-02-09 16:26:53,080 - DEBUG - [chan 0] lstat('/home/aldur/test_bis/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx\xc3\xa0')
2016-02-09 16:26:53,206 - DEBUG - EOF in transport thread

A possible cause for the issue may be that Paramiko (and many others) expects the server encoding to be utf-8 and Hetzner doesn't provide it. On the other side, I found this issue that makes clear that Paramiko crashes with non-unicode filenames.
So, in conclusion, I won't be able to fix this until either Hetzner changes the default file encoding or Paramiko changes the decoding behaviour.

I see :-( Thank you very much for investigating!


Add CONTRIBUTING.md

On branch feature/contributing-guide
Changes to be committed:
new file:   CONTRIBUTING.md
Close #87

@SemyonSinchenko - this is a great start, thank you!  I am going to merge this and then add some suggested edits.  Will run those by you before merging, thanks!


design: update footer design

I made some modifications to the footer design, what do you think? Feel free to give feedback!😚😚

It's a very good code! I think it would be better if you just change the comment to English! 😗


bug(transport-webrtc) Max Message Size differs from Spec

https://github.com/libp2p/js-libp2p/blob/a41d25d49696febd7fd903bbdcc95ebaeb5d4b35/packages/transport-webrtc/src/private-to-public/sdp.ts#L136
Hi, I am reviewing the spec as I implement it in https://github.com/libp2p/rust-libp2p/pull/4248 when I noticed this is not in accordance with the spec
A MUST set the a=max-message-size:16384 SDP attribute.

ref: https://github.com/libp2p/specs/blob/master/webrtc/webrtc-direct.md#browser-to-public-server
I'm not sure what the impact is as I've used js-WebRTC and it seems to work fine, but I wanted to raise the issue nontheless

Thanks for spotting this @DougAnderson444 to my understanding it's an oversight, it was even mentioned on a previous issue where we discussed max message size


Missing confirma values?

This is more of a doubt, but we declare configmap vault to have values
    --from-literal "load_balancer_address=${LB_IP}" \
    --from-literal "gcs_bucket_name=${GCS_BUCKET}" \
    --from-literal "kms_key_id=${KMS_KEY}"

but on vault deployment file we use many other values
env:
        - name: GCS_BUCKET_NAME
          valueFrom:
            configMapKeyRef:
              name: vault
              key: gcs_bucket_name
        - name: KMS_PROJECT
          valueFrom:
            configMapKeyRef:
              name: vault
              key: kms_project
        - name: KMS_REGION
          valueFrom:
            configMapKeyRef:
              name: vault
              key: kms_region
        - name: KMS_KEY_RING
          valueFrom:
            configMapKeyRef:
              name: vault
              key: kms_key_ring
        - name: KMS_CRYPTO_KEY
          valueFrom:
            configMapKeyRef:
              name: vault
              key: kms_crypto_key
        - name: LOAD_BALANCER_ADDR
          valueFrom:
            configMapKeyRef:
              name: vault
              key: load_balancer_address

Aren't we missing some values here? I'm asking this because my pods are failing to deploy because of this:

The config map looks like this:
kubectl create configmap vault \
  --cluster="$(gke-cluster-name "vault")" \
  --from-literal="load_balancer_address=$(vault-lb-ip)" \
  --from-literal="gcs_bucket_name=$(google-project)-vault-storage" \
  --from-literal="kms_project=$(google-project)" \
  --from-literal="kms_region=$(google-region)" \
  --from-literal="kms_key_ring=vault" \
  --from-literal="kms_crypto_key=vault-init" \
  --from-literal="kms_key_id=projects/$(google-project)/locations/$(google-region)/keyRings/vault/cryptoKeys/vault-init"

Are you sure you're on the correct repo? Between this and your earlier issue, I'm wondering if you're using an out-of-date fork?

@sethvargo Hey Seth, thank you for your reply! As I linked on the other issue, I'm looking at https://codelabs.developers.google.com/codelabs/vault-on-gke/index.html#9. Hum... I don't quite understand what is going on. The code lab seems pretty different from what you just pasted here. Am I looking at the wrong spot, maybe?

The codelab content isn't pulled directly from here. I've updated it and it should match now.

@sethvargo thank you!


[Wave 8: Add tax tracking] Add new input fields for tax tracking in Money requests

Problem
Internal master Issue:https://github.com/Expensify/Expensify/issues/338212
Coming from this section in design doc https://docs.google.com/document/d/1nkusVPiYN3uYCJAH_2XknBv_oPpNOifVxheuxRvFTxs/edit?pli=1#bookmark=id.l319wrhremwa
This issue is divided in 2 phases to keep PR's small, test use cases efficiently and deliver in milestones
Phase 1
In phase 1, we create a simple input fields that can allow inserting, editing and viewing tax details
As discussed in design doc, we need to create tax selector and tax amount components. Also add handles to update transaction tax details in Onyx and also pass tax details to API
Components and handlers should be created in a new way following this refactor PR https://github.com/Expensify/App/pull/28618
Phase 2
In phase 2, we'll add more logic to tax input fields.

Handling and displaying system messages when tax rates are updated
When updating category, we need to apply category expense rule and hence update tax rate field and tax amount field accordingly
As mentioned in design doc, only specific users can edit the tax details depending on the state of report

Why is this important?
To allow users to track tax on the expenses, and migration users to newdot.
Solution
Implement the section of the design doc

Discussing here https://expensify.slack.com/archives/C03UK30EA1Z/p1700633473392829

We're discussing next steps in slack.
Artem Makushow and Eto Olei are going through design doc and will start working on it soon

Not overdue!

Draft PR is up!

@teneeto this is the formulae to calculate tax which will be required.
const percentage = // selected by user from policyTaxRates_collection
const divisor = (percentage.slice(0, -1) / 100) + 1; // slice to remove % at the end; converts "10%" to "10"
return (parseInt(Math.round(amount - (amount / divisor)), 10)) / 10; // amount is the expense amount of transaction

Assigning @alitoshmatov to this issue as they helped reviewing the PR

We have merged first PR 🎉
We'll now be working on second PR to view and allow updating fields

Teeneto and I had a sync yesterday and teeneto will be working on second part of the issue

Draft PR for Edit request is up!

@teneeto the new API commands to call to update tax rate and tax amount are UpdateMoneyRequestTaxRate and UpdateMoneyRequestTaxAmount. Command takes common args such as transactionID and optimisticReportActionID and specific args - taxCode: string and taxAmount: int respectively
Please refer to UpdateMoneyRequestDate command
We have to do in a similar way
https://github.com/Expensify/App/blob/70f3b99c0b5b53d8be84a07f6b0277cbfeda6df4/src/libs/actions/IOU.js#L1044

Automation created issue for a payment here - https://github.com/Expensify/App/issues/33441.
@MonilBhavsar Should the payment be handled on that issue? I am just confused since this issue also exists

We'll handle the payment here. Let's close that issue

Is draft PR ready for review or are we waiting for something else?

Is draft PR ready for review or are we waiting for something else?

Hi @alitoshmatov a draft PR is ready here: https://github.com/Expensify/App/pull/33927
Just waiting for a few BE changes to be finalised and then we'll continue AFFAIK.

Yes correct!
We had to change backend majorly and had to discuss. Discussion has concluded and it is being implemented now

One backend PR is merged. We're waiting on other two to be merged

We're still awaiting Web-E PR to be merged and deployed

This also currently going through a small refactor to use taxRates from policy_ rather than policyTaxRates_ keys.

Same^

@alitoshmatov the second PR is ready for review!
Thanks @teneeto 🙇

Is there any plan for our next step on this feature?

We're working on other parallel issues. We can issue payment here and close this now

@kadiealexander Can we complete payment and close this one

@MonilBhavsar I'm finding this hard to follow, could you please quickly summarise who is due payment for what?

Payment summary: Pay $1000 to @alitoshmatov for reviewing two PR's created before the price update

https://github.com/Expensify/App/pull/33927
https://github.com/Expensify/App/pull/32550

There were some regressions coming out of it, but since it was a new feature and lots of new introductions to App, i think it's fine to pay full payment.

Eto Olei is from Callstack and does not need payment

@alitoshmatov I've sent you an upwork contract.

Payouts due:

[x] Contributor: $1000 @alitoshmatov

Upwork job is here.


Add get_tree and set_tree methods to irmin-graphql server

Unfortunately there isn't a good way to model the tree input arguments as recursive objects (as I had hoped):
{
    "a": {"b": {"c": "123"}},
    "foo": "bar"
}

Instead, we have to use a flat array of objects:
[
    {"key": "a/b/c", "value": "123"},
    {"key": "foo", "value": "bar"}
]

Despite this one minor flaw, I think this is a pretty nice way of supporting read/write transactions in irmin-graphql!

Unfortunately there isn't a good way to model the tree input arguments as recursive objects

Can you detail why it's not possible? I am fine to merge that PR but I would like to understand the design constraints :-)

There is just no way to construct a recursive (or mutually recursive) input argument. For example, my initial try:
type tree = {
  key: string;
  tree: tree option;
  value: string option;
  metadata: string option;
 }

let rec tree () = Schema.Arg.(
  obj "Tree"
    ~fields:[
       arg "key" ~typ:(non_null string);
       arg "tree" ~typ:(tree ());
       arg "value" ~typ:string;
       arg "metadata" ~typ:string;
    ]
    ~coerce:(fun key tree value metadata -> {key; tree; value; metadata})
)

creates a stack overflow.. Also, making tree lazy would raise Lazy.Undefined in this case.
GraphQL really only works with recursion of a known depth1. which means the return value from get_tree would pose a problem as well.
This final implementation seems to be more in-line with the way GraphQL is meant to be used, so even if there are workarounds to the infinite loop issue, I think it makes sense to stick with the array-based version regardless.
1 https://github.com/facebook/graphql/issues/91#issuecomment-254895093

Hum ok I see. Maybe we can allow to pass "arbitrary" JSON trees and consider them as Json_tree contents? That seems a bit annoying to serialise a nice tree into a collection of key/values pairs. But I guess it's fine as a first step.

Yeah, it would definitely be possible to pass trees as JSON encoded strings — I will spend some time today to see if that’s a better approach.


Capitalised the titles of the markdown tables

Hey @AppDevMichael, this PR isn't needed at all considering this is not the standard practice when writing frontmatter. Also, this would break the build and is a very risky change.
I am closing this for the mentioned reasons.


Initial commit

Adding PHP Open Source SDK to project

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@paypay-ayas let me know when this can be reviewed


Remove Travis traces

There were a few more places in the CMake/Manifest.in that were referencing travis, this should remove them.
for landing in beta 16

Codecov Report

Merging #1412 (2e6c184) into main (cbef407) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1412   +/-   ##
=======================================
  Coverage   85.99%   85.99%
=======================================
  Files         200      200
  Lines       20934    20934
  Branches     2459     2459
=======================================
  Hits        18002    18002
  Misses       2331     2331
  Partials      601      601

Flag
Coverage Δ

py-unittests
85.99% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cbef407...2e6c184. Read the comment docs.


Lifecycle broken (shouldComponentUpdate) from 2.3.0 to 2.4.0

Hey guys,
our tests stopped working since yesterday, apparently after the new 2.4.0 release.
It seems like the lifecycle hook shouldComponentUpdate is not triggered when updating props. Here is an example to reproduce it.
const customRenderMixin = {
  shouldComponentUpdate () {
    console.log('should update')
    return false
  },
}

const TestComponent = React.createClass({
  mixins: [customRenderMixin],
  propTypes: {
    onUpdate: PropTypes.func.isRequired,
  },
  componentWillReceiveProps () {
    console.log('receiving props')
  },
  componentWillUpdate (...args) {
    console.log('receiving update')
    this.props.onUpdate(...args)
  },
  render () {
    return null
  },
})

test('component should not update with no change', t => {
  const onUpdateSpy = spy()
  const props = { onUpdate: onUpdateSpy }
  const wrapper = shallow(<TestComponent {...props} />)
  wrapper.setProps(props)

  t.equal(onUpdateSpy.called, false, 'component should not re-render')
  t.end()
})

With version 2.3.0
  component should not update with no change

    receiving props
    should update
    ✔ component should not re-render

With version 2.4.0
  component should not update with no change

    receiving props
    receiving update

    ✖ component should not re-render
    ---------------------------------
      operator: equal
      expected: false
      actual:   true

  Failed Tests: There was 1 failure

    component should not update with no change

      ✖ component should not re-render

Thanks for the report @emmenko, I believe https://github.com/airbnb/enzyme/pull/491 should fix your issue.

@Aweary oh awesome, I missed it :) Many thanks!! 👍

Published 2.4.1 which should have the fix!


support foundry sign() cheatcode

What title sayas.

Codecov Report

Merging #18 (258a555) into main (c6a879b) will increase coverage by 0.14%.
The diff coverage is 90.90%.

@@            Coverage Diff             @@
##             main      #18      +/-   ##
==========================================
+ Coverage   78.19%   78.34%   +0.14%
==========================================
  Files          19       19
  Lines        1642     1653      +11
  Branches      336      337       +1
==========================================
+ Hits         1284     1295      +11
  Misses        207      207
  Partials      151      151

Impacted Files
Coverage Δ

src/debug/foundry_cheatcodes.ts
92.72% <90.90%> (+1.81%)
:arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Validation failed: API Deprecated

{"code":"InvalidContentLink","message":"Unable to download deployment content from 'https://gallery.azure.com/artifact/20161101/Microsoft.CustomScriptExtension-arm.2.0.50/Artifacts/MainTemplate.json'. The tracking Id is 'aecd1ab5-a90a-46f1-9ab3-e0e6de95ec16'. Please see https://aka.ms/arm-deploy for usage details."}

Hi @m05tr0-DevOps ,
Could you please provide more details about the issue like in which lab you faced this issue, step details etc?
Thanks

Selenium template is a good example of this, hit this today.
master/labs/vstsextend/selenium/armtemplate/azuredeploy.json

Just to tack on a little more information....
Step 2 of the lab ask the user to deploy the following template to Azure
https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fraw.githubusercontent.com%2FMicrosoft%2Falmvm%2Fmaster%2Flabs%2Fvstsextend%2Fselenium%2Farmtemplate%2Fazuredeploy.json
which is the azure template found in this repository ...
https://github.com/microsoft/azuredevopslabs/blob/master/labs/vstsextend/selenium/armtemplate/azuredeploy.json
Line 81 has the following uri
https://gallery.azure.com/artifact/20161101/Microsoft.CustomScriptExtension-arm.2.0.50/Artifacts/MainTemplate.json
Which will report a
410 - Gone
with the following message
"This API is deprecated. Please contact<EMAIL_ADDRESS>for more details."
If a mirror can be found for that file and line 81 replaced, things should be back to normal.

Others labs have the same issue due to gallery depreciation.
Another example is https://github.com/MicrosoftLearning/AZ400-DesigningandImplementingMicrosoftDevOpsSolutions/blob/master/Instructions/Labs/AZ400_M14_Deploying_apps_with_Chef_on_Azure.md
Lab is using gallery to get chef automate.... Any workaround/Fixes??


Apache2 Permission denied AH00035

BUG REPORT INFORMATION
docker version:
Client:
Version:      1.8.2
API version:  1.20
Go version:   go1.4.2
Git commit:   0a8c2e3
Built:        Thu Sep 10 19:19:00 UTC 2015
OS/Arch:      linux/amd64
Server:
Version:      1.8.2
API version:  1.20
Go version:   go1.4.2
Git commit:   0a8c2e3
Built:        Thu Sep 10 19:19:00 UTC 2015
OS/Arch:      linux/amd64
docker info:
Containers: 112
Images: 56
Storage Driver: aufs
Root Dir: /var/lib/docker/aufs
Backing Filesystem: extfs
Dirs: 280
Dirperm1 Supported: true
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.19.0-28-generic
Operating System: Ubuntu 14.04.3 LTS
CPUs: 4
Total Memory: 3.852 GiB
Name: ubunjeff
ID: 7PU2:EG7P:7OVK:TQAZ:HLJY:GXSQ:DMBF:SNEJ:GNMU:4D4C:ZGEO:ZXEI
WARNING: No swap limit support
uname -a:
Linux ubunjeff 3.19.0-28-generic #30~14.04.1-Ubuntu SMP Tue Sep 1 09:32:55 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
Steps to reproduce the issue:
I have thoses files :
./www/jQuery/css/uidarkness/test.css
.test { width:100%; }

./www/index.html
<link href="jQuery/css/uidarkness/test.css" rel="stylesheet" type="text/css"/>

./Dockerfile
FROM debian
ENV DEBIAN_FRONTEND noninteractive
RUN apt-get -y update && apt-get install -y apache2
COPY ["www","/var/www/html"]
RUN chgrp -R www-data /var/www && find /var/www -type d -exec chmod 775 {} + && find /var/www -type f -exec chmod 664 {} +
EXPOSE 80
CMD ["/usr/sbin/apache2ctl","-DFOREGROUND"]

Build command line :
docker build -t test .
Running command :
docker run -d -p 80:80 test
Go to the browser :
http://localhost/
Use browser debug mode, inspect element. I can see error :
GET http://localhost/jQuery/css/uidarkness/test.css 403 (Forbidden)
Connect to the container :
docker exec -it e5947c26b5ec bash
cat /var/log/apache2/error.log
getting Apache error :
Permission denied: [client <IP_ADDRESS>:38503] AH00035: access to /jQuery/css/uidarkness/test.css denied (filesystem path '/var/www/html/jQuery/css') because search permissions are missing on a component of the path, referer: http://localhost/
HOW TO FIX THE PROBLEM ?
Just type still in bash container :
ls /var/www/html/jQuery/css/uidarkness/
Refresh brower : fixed !
Is it magic ?
Files permissions into container are :
drwxrwxr-x 4 root www-data 4096 Oct  3 09:33 /var/www/html
-rw-rw-r-- 1 root www-data   80 Oct  3 09:32 /var/www/html/index.html
drwxrwxr-x 4 root www-data 4096 Oct  3 09:33 /var/www/html/jQuery
drwxrwxr-x 4 root www-data 4096 Oct  3 09:33 /var/www/html/jQuery/css
drwxrwxr-x 2 root www-data 4096 Oct  3 09:33 /var/www/html/jQuery/css/uidarkness
-rw-rw-r-- 1 root www-data   25 Oct  3 09:32 /var/www/html/jQuery/css/uidarkness/test.css

Hi!
Please read this important information about creating issues.
If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
This is an automated, informational response.
Thank you.
For more information about reporting issues, see https://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
uname -a:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

Hm, I think I've seen a similar issue, which was related to the aufs driver. IIRC, using a sync worked on that occasion. You could also try to split up your RUN chgroup... line to multiple RUN statements, then work from that.
I'll try to find the reference to the other issue, but perhaps the above helps to find a solution.

Hi,
"RUN chgroup" on different lines did nothing.
Fixed by using "devicemapper" instead of "aufs" thanks to this post :
http://muehe.org/posts/switching-docker-from-aufs-to-devicemapper/

Let me close this ticket for now, as it looks like it went stale.


Cache rebuile every time

Expected Behavior
Expect cache will work
Actual Behavior

Cache not work
Each time start up, cache will rebuild
Is an error being thrown?
[hardsource:cloud] Cache is corrupted.
Error: ENOENT: no such file or directory, open './run/webpack_cache/hard_source/cloud/module~/log0053'
[hardsource:cloud] Last compilation did not finish saving. Building new cache.
Steps to Reproduce
  return new HardSourceWebpackPlugin({
    cacheDirectory: `${path.join(process.cwd(), './run/webpack_cache/hard_source/[confighash]')}`,
    configHash: process.env.EGG_DEPLOY === 'cloud' ? 'cloud' : 'default',
    cachePrune: {
      sizeThreshold: 300 * 1024 * 1024,  // 300 MB
    },
  });

Operating System, Node, and NPM dependency versions
Mac OS 10.11.6
Node 8.9.1

"hard-source-webpack-plugin": "^0.12.0",

Same when using:
"hard-source-webpack-plugin": "^0.12.0"
"webpack": "^4.6.0"

Only works when comenting "cacheDirectory" and using default config.


Remove downgrading NetworkManager for Centos node image

In v1.41.7 version of NM is not showing a failure when creating a bridge

tested here

/test-integration-metal3-dev-tools-centos

/test-integration-metal3-dev-tools-centos


Docker image crashes on load with GLIBC warning

The docker image pushed today (digest 4c65a20afb15) fails to start for me with this error:
Module /usr/lib/redis/modules/redisearch.so failed to load: /lib/x86_64-linux-gnu/libm.so.6: version 'GLIBC_2.29' not found (required by /usr/lib/redis/modules/redisearch.so)
I foolishly deployed with ':latest' still in the spec, and now my production site is wedged.  Any workaround advice is appreciated. If anyone knows the sha of the image just before this one, please post it.

I tried to restart with the most recent image I could find in my local docker repo, sha 2be634e2fd2476df4583eb0914aa49a9f5859f7a7c07c7a55403fd81681526b6, but it would not load my RDB file.  In desperation I copied the version of /usr/lib/redis/modules/redisearch.so out of that image and built a new image of my own based on redislags/redismod:latest and just plopped that .so file on top.  I suspect that I will find out that doing so is what is known in the business as a Very Bad Idea, but at the moment it seems to have got my installation back online.

we also had the same issue,
"Module /usr/lib/redis/modules/redisearch.so failed to load: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found (required by /usr/lib/redis/modules/redisearch.so)"
I guess it might be worth to keep more previous release on dockerhub, in case the latest docker build has issues.

We have a Discord user who is having this same problem as well.

Oy, I'm sorry this happened!  First off - I just validated with the redislabs/redismod:edge, and that container works. However, it's literally the tip of the edge. I just pushed up this PR to fix this issue properly, for the latest link.
Were you to clone that pull and run a docker build . in the root of your clone, you will receive a working docker - if you're blocked.


Only externalize node built-ins

The purpose of this PR is to make it possible to yarn build a production build then just copy the public + build folders on a server and be able to completely run Volto with just that.
With the changes here I was able to do that, but there's a strangeness in the formidable package that requires a patch.
To replicate:

pull this PR
apply formidable patch
yarn build
copy build + public folder to another location
in that location, run RAZZLE_API_PATH=http://localhost:8080/Plone NODE_ENV=production node build/server.js

Well, the tests didn't like it at all 😂

Treating warnings as errors because process.env.CI = true.
Most CI servers set it automatically.

Failed to compile.

./node_modules/express/lib/view.js
Critical dependency: the request of a dependency is an expression

Webpack spits out warnings and CI treats them as errors. I could make a list of these special dependencies and put them in a subfolder with a package.json, for easy unified instal.


Overhaul Predicate simplifier: In simplifier

Part of #2570

Review checklist
The author performs the actions on the checklist. The reviewer evaluates the work and checks the boxes as they are completed.

[ ] Summary. Write a summary of the changes. Explain what you did to fix the issue, and why you did it. Present the changes in a logical order. Instead of writing a summary in the pull request, you may push a clean Git history.
[ ] Documentation. Write documentation for new functions. Update documentation for functions that changed, or complete documentation where it is missing.
[ ] Tests. Write unit tests for every change. Write the unit tests that were missing before the changes. Include any examples from the reported issue as integration tests.
[ ] Clean up. The changes are already clean. Clean up anything near the changes that you noticed while working. This does not mean only spatially near the changes, but logically near: any code that interacts with the changes!

This is not directly related to your PR, but do you think we should update the In documentation so it doesn't refer to Semantics of K anymore?

Hmm, I think all the Syntax modules do that. Do you want to open an issue for this?