Include Cursor in the initial SQL population

The test for this also required a bit of a fix in the Cursor scope
initialization. If you persist a Key<?> in some object in Datastore, it
persists just the standard data you'd expect, basically the parent, the
kind, and the object's ID/name. Then, when you load it back in from
Datastore it uses the app ID of whatever environment you're loading in
(the Key contains this info even though it isn't included in the
toString() of Key)
If you persist the websafe string format of a Key (which is what we do
for Cursors), it includes the app ID so when you load it, it contains
the old app ID not the new one (if the app ID has changed).
In the pipelines, we use the standard default environment which has a
different app ID from the test environment that's set up by the
DatastoreEntityExtension.
As a result, we should check in Cursor to see if the key is any
cross-tld-key, rather than the exact one that exists within this app
environment.

This change is

Commit message updated


fix(client): refactor formfields

Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] All the files I changed are in the same world language, for example: only English changes, or only Chinese changes, etc.

Closes #39520

Since we're refactoring, I think it's worth renaming things to improve clarity a bit. For instance, passing formFields to FormFields is a bit confusing to me.  How about formFields -> attributes and those attributes could be{ name: 'name', label: 'label' }?

How about formFields -> attributes and those attributes could be{ name: 'name', label: 'label' }?

If you think this is clearer, then I will do this. It is just, name is not used as many attributes (HTML), but label is not used as any attribute (HTML).

Good point, label is clearly wrong - at the very least it should be labelText.
So, the ideal solution is probably to use a map from formFields to <FormField/> components, but that's a marginal improvement and a fair bit of work.  How about just renaming field -> name and fieldLabel -> labelText?  At least then we're being a little more specific.

@ojeytonwilliams I have edited my previous comment, as I accidentally said the opposite of what I meant by the name (currently field) property.
I prefer the property of the current fieldLabel to be changed to label. However, my point was more to do with changing the name of formFields (the array of object literals) to attributes.
This is more work, and risks more confusion than not, but what if we:

separate the current field from fieldLabel
rename formFields -> attributes
convert renamed attributes to an array containing 'solution', 'githubLink'
pass a separate array labels containing the fieldLabels

I think passing two arrays would just make things needlessly messy.  What you have now seems good, but I'd go back to formFields because, as you rightly pointed out, label is not an attribute.

Thanks for sorting that out @Sky020.  There're a few minor things we can do to clean it up further, but I'll wait until Randy has taken another look.  Just in case he spots something more substantial.

@Sky020 @ojeytonwilliams Looks good now.  I like the fact that you got rid of the attributes prop.  That was confusing.

Seeing as we're already reviewing it, I figured it was ready for review!

Hey Shaun, I've removed the merge commit and removed the comments from the first commit.  Let me know if everything still looks good.

Thanks, for doing that, Oliver. Everything looks ready to go.

Cool, thanks for verifying.  @ahmadabdolsaheb could you give this a quick sanity check?


variants --consensus is too slow

Hello,
I have about 100.000 reads from Nanopore and 4.6 Mbp genome. Also i have 24 threads.
After Canu assambly, minimap2 alignment with -L flag, samtools I have sorted(indexed) bam file and not polished genome.
I run the command:
sudo python /nanopolish/scripts/nanopolish_makerange.py not-polished-genome.fa | parallel --results dir-nanopolish-res -P 8
./nanopolish variants --consensus -o new.{1}.vcf -w {1} --ploidy 1 --reads file.fastq --bam sorted.bam --genome  not-polished-genome.fa -t 3 --min-candidate-frequency 0.1
When using programs that use GNU Parallel to process data for publication please cite:
information about citation
Number of variants in span(14) would exceed max-haplotypes. Variants may be missed.  Consider running with a higher value of max-haplotypes!
A lot of such messages
[post-run summamry] total reads: 1289, uparsiable: 0, qc fail: 1, could not calibrate: 0, no alignment: 11, bad fast5: 0
And two or three messages about post-run
It is going for a night and all morning.
Is it normal or am i doing smth wrong?
Before i tried it only for variants with reference genome and it takes from thursday to... in the morning of Monday i had a lot of not empty vcf files.

Hi,
There are few reasons why nanopolish might be slower than expected:

Excessive sequencing coverage (you don't need more than 100-200x to polish)
Excessive number of candidate variants

For the first issue, you can try downsampling the data. For the second issue, you can remove the --min-candidate-frequency 0.1 option and use the default.
Jared

samtools view -s can be used to subsample a BAM file to lower its coverage

Seems that it helps a bit.
A lot of thanks.

Hello,
Sorry, should I give a half of --reads too?
I made view -s 0.5 with bam file and didn't change the reads. I don't know what reads to delete.

No, you don't need to change the --read. It will only use reads that have alignments in the downsampled BAM.
Jared

I began this 07.02 and it is still counting...
I count [post-run summary] total reads and the number is 55 859 reads. Is it normal time for this task?
Does it show in post run summary reads from bam file?
In --reads I have 111111, in bam file I expected (view -s 0.5), so 55555 reads. I didn't check the number of reads after view -s 0.5.

Maybe I can pause the process and then restart?

No, you can't pause and restart sorry.
I'm not sure I understood your message from 2 days ago, can you clarify what you're asking?

Sorry if my question confused you.
I'd like to polish my genome(4.6 Mbp, 50.000 reads) and it seems to me that if this polishing goes more then a week, I'm doing smth wrong. Am I right? I try to find the reason of this extra slow working.
I need to use my computer and couldn't wait one more week( and now I'm not sure that one more week or two helps me.

One week seems a bit slow. The command from your first post says you are running 8 polishing tasks in parallel, each that uses 3 threads. Does your computer have 24 cores? If not it might be slow because your computer is overloaded.

Thank you for the answer.
I checked settings of my virtual machine and it has 24 threads as max. But I can't do smth more on it now.
Could you please explain me what reads are displayed in post-run message: reads from --reads (111.111) or reads from bam file (I checked - 59522)? I try to count time for finish.

If you count the number of VCF files that it has produced, it is a good measure of how far along it is. Each VCF is a 50kb segment of the genome, and your genome is 4.6MBp, so you should have about 90 of them when it is done.

Finish!
so it takes 12 days to polish. Unfortunately,I didn't find the reason of such slow working.
I'll be very pleased if you comment some tips from the result.
I have some messages like:
Warning: 4607 variants in span, region not called [4608943 4610878]
Warning: 4310 variants in span, region not called [4610830 4612698]
Why could it be so? what will be there in my polished genome?
After vcf2fasta i have such message:
[vcf2fasta] rewrote contig  with 3925 subs, 31630 ins, 1323 dels (1 skipped)
Does it mean that one deletion is missed? Could i know where it is? Is it because warnings with variants?
A lot of thanks,
Valery
1 skipped

Those warnings give us a hint about why your run might be slow. It appears the draft assembly had many more errors than expected, so nanopolish had a lot more work to do. What assembler did you use to make the draft assembly?

Canu with all steps and default settings.
I have another one from miniasm, but suppose that it is worse then canu. And after miniasm I used racon.
Maybe I try to use nanopolish after miniasm.
I have not so much these messages, less then 50.

Nanopolish will not work with a miniasm assembly, you need to run racon at least once first before polishing.

Thank you very much for helping me.


[DO NOT MERGE] Auto PR to update dependencies of istio

This PR will be merged automatically once checks are successful.
none

@istio-testing: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-pilot-e2e.sh
96786d83cd5026c6c2016e1991f63e319ab05e6d
link
/test istio-pilot-e2e

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


MigrationSurchargeMultiplier - log file showing a lot of overflow detected

Current Behavior
During scrolling through the log files of my renterd I found a lot of entries (about 500 a day) with the following message:
failed to apply the 'MigrationSurchargeMultiplier', overflow detected
I don't know if it an bug or only a warning message.
Currently I had a lot of files in my renterd where the migration is impossible due missing slabs (9/30).
Expected Behavior
Currently I don't know what the expected behavior is.
Steps to Reproduce
No response
Version
v1.0.2
What operating system did the problem occur on (e.g. Ubuntu 22.04, macOS 12.0, Windows 11)?
Ubuntu 22.04
Autopilot Config
{     "contracts": {         "set": "autopilot",         "amount": 70,         "allowance": "4121975928000000000000000000",         "period": 6048,         "renewWindow": 2016,         "download":<PHONE_NUMBER>00,         "upload":<PHONE_NUMBER>00,         "storage":<PHONE_NUMBER>000,         "prune": true     },     "hosts": {         "allowRedundantIPs": false,         "maxDowntimeHours": 336,         "minRecentScanFailures": 10,         "scoreOverrides": null     } }
Bus Config
{     "default": "autopilot" }   {     "hostBlockHeightLeeway": 6,     "maxContractPrice": "1000000000000000000000000",     "maxDownloadPrice": "740910485000000000000000000",     "maxRPCPrice": "1000000000000000000000",     "maxStoragePrice": "71016463040",     "maxUploadPrice": "90176686000000000000000000",     "migrationSurchargeMultiplier": 20,     "minAccountExpiry":<PHONE_NUMBER>0000,     "minMaxCollateral": "1500000000000000000000000000",     "minMaxEphemeralAccountBalance": "1000000000000000000000000",     "minPriceTableValidity":<PHONE_NUMBER>00 }  {     "minShards": 10,     "totalShards": 30 }  {     "enabled": true,     "slabBufferMaxSizeSoft":<PHONE_NUMBER> }
Contract Set Contracts
fcid:df7fcd0c1450817c8395b4464c9728f921099db66b4a0c65613700d63c90230a
Anything else?
No response

@danielMd2805 have you ever updated your gouging settings? More specifically the migrationSurchargeMultiplier or maxDownloadPrice fields?
The message you are seeing happens when migrationSurchargeMultiplier * maxDownloadPrice results in a number that is larger than 128 bits. Looking at the provided settings that should not be the case. So I'm wondering if the settings were higher at some point and you lowered them again?

Fixed in #960


Fix/assert file owner requires sudo

This PR solves the problem mentioned in #37 and #27

I'll come back to this as there is no way to test changes locally and there is a learning curve to figure out bits and bobs with Travis.

While I decided to leave I found out I was using the wrong var name. Fixed it. However, again, I'll leave it to later as it fails something completely different and hard to figure/test etc.

I rebased this on master and removed the changes that duplicated my work. (I noticed too late that you did the same work.)

Thanks for your PR.


ParentChangedNotifier Target null causing crash

Hi,
I'm using MvvmCross for my application, and it involves a presenter to show your Views. My presenter is just a Window and I replace the Windows content with the view when navigating. I noticed that if I switch views, my app will crash at ParentNotifiers's Remove method, specifically:
    _inner[singleOrDefault].Target.Dispose();

Honestly, I'm not sure if this is because I'm using MvvmCross or I'm doing something wrong, just wanted to give you guys some context.
I can just add a check to make sure Target isn't null before disposing it and it will work, but is this going to cause any memory leaks or issues?

I fixed it the way you propose, because when the Target is null (or not alive) it's safe to not call Dispose.

Please read the comment on c72a992


When using Bootstrap Collapse the scroll gets broken

Whenever expanding a Bootstrap Collapse the scroll is calculated as if it was not expanded, thus highlighting the wrong elements.
Is there a way to fix this?

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/26313696-when-using-bootstrap-collapse-the-scroll-gets-broken?utm_campaign=plugin&utm_content=tracker%2F284936&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F284936&utm_medium=issues&utm_source=github).

I have exactly the same question, did anyone find a workaround?

Also doesn't work with Foundation Accordions: the active status sticks to the first tocify-item, whose header is hidden (inside the collapsed accordion).


[envsubst] update

52185e007883e73da5599522fb83a3d051154481b61053c75b4499d7162153ec

https://github.com/a8m/envsubst/releases
I close this PR because 1.3.0 does not released.


Share project git repository across plans

Currently the discover step always creates in the workdir a new copy of the project git repository for each plan. It would make sense to copy the repository only once and use symlinks from individual plan workdirs to safe disk space.

yeah, makes sense to me, currently I do not see any problems doing that

Would be nice to unify somehow the directory structure for saving such data, feels a bit like rpms, maybe other artifacts needed by other steps could share this unified space together

I'd prefer to avoid this, as the runtime can modify those cloned-out repositories, right? If one runs make, in some prepare phase, and it runs in that directory, it's contents is modifired, right?
To me it sounds like worktree has the functionality we need (instead of symlinks). You can think of it like git symlink.
To elaborate: In case we'd want to manage the repo clone "ourselves", we'd have to always store,and reset the commit for that repo (runs can have different commits). And always remove all untracked files before some run (and store+track those modifications / untracked files for the previous runs). But that's IMO like reinventing the worktree I've mentioned above.
AFAIR the only limitation is that you shouln't push, or commit into same branch in different worktrees (not sure how those conflicts are created / resolved, I just recieved that guideline from git maintainer:)).

Would be nice to unify somehow the directory structure for saving such data, feels a bit like rpms, maybe other artifacts needed by other steps could share this unified space together

It's hard for me to imagine other usecases - what steps would benefit from this caching?

@pvalena did not think about that (make example) I guess that makes sense, feels dangerous! Thanks @pvalena
So I take my good idea of this back ...
@psss seems this would break cases where people for example build in each plan differently the git repo, etc.

Maybe, in case I didn't write it clearly enough in my previous comment:

In general this is a good idea
please do not use symlinks
please do not implement our-own-caching-tm
let's use worktree functionality which does exactly what we need

Thanks for bringing the idea of using worktree for this. Seems this could be quite useful although we would not save as much disk space as we would if using symlinks. On the other hand, there really could be unexpected results if several plans are modifying the same work tree. Especially if we plan to support a parallel execution of plans.
Was playing a bit with the feature and I see one possible limitation: It seems it's not possible to checkout the same branch into multiple worktrees:
> git checkout master
fatal: 'master' is already checked out at '/tmp/tmt'

But, perhaps, for our use cases using a detached worktree would / could be enough?

Closing in favor of #423 which has a nice outline of the solution and is already assigned by @thrix.

Oh, I forgot we still want to cover the following here:

discover step should use a symlink if url and ref are not provided

This is blocked by #423. Sorry for the spam...

@psss I guess that can be part of #423 also ... seems I will be a bit area also there


[BUG]: Linux Image BUG occurred after using solution

How are you running AnythingLLM?
AnythingLLM desktop app
What happened?
while creating a new work space, error occurred like this
Error:Invalid 'prisma.workspaces.create()' invocation: The table 'main.workspaces' does not exist in the current database
Are there known steps to reproduce?
First, I met the same issues in #1077.
Then I follow the solutions there, but a new bug cameout as mentioned while I tried to create a new workspace.

Lets move this conversation to that issue because it is absolutely the same issue if running on desktop.
This did not resolve the issue?
./AnythingLLMDesktop.AppImage --appimage-extract && \
cd squashfs-root && \
./AppRun

Lets move this conversation to that issue because it is absolutely the same issue if running on desktop.
This did not resolve the issue?
./AnythingLLMDesktop.AppImage --appimage-extract && \
cd squashfs-root && \
./AppRun

Yes, after i use this solution, than go to create a new workspace, this happenedError:Invalid 'prisma.workspaces.create()' invocation: The table 'main.workspaces' does not exist in the current database

In ~/.config/anythingllm-desktop do you have a file named anythingllm.db in the root or in a subfolder named storage?
Additionally, can you locate a .env file in that same folder and grep the STORAGE_DIR variable and see what is says?
It should be an absolute path

Okay the STORAGE_DIR looks okay, but the anythingllm.db should not be fully empty. This indicates that the migration never ran and that explains the error.
This can force run the migration:
cd squashfs-root/resources/backend
node ./node_modules/prisma migrate dev --name init
I will say, running ./AppRun is supposed to do this exact same thing and for others runs without issue

Okay the STORAGE_DIR looks okay, but the anythingllm.db should not be fully empty. This indicates that the migration never ran and that explains the error.
This can force run the migration: cd squashfs-root/resources/backend node ./node_modules/prisma migrate dev --name init
I will say, running ./AppRun is supposed to do this exact same thing and for others runs without issue

I follow your steps, and terminal shows
Error code: P1012 error: Environment variable not found: DATABASE_URL.
in this two lines:
provider = 'sqlite'
url =  env('DATABASE_URL')
It seems a environment variable problem...

Then in .env add an env named DATABASE_URL and have it set to the absolute path to the anythingllm.db file that is currently empty and re-run the two prisma commands. Again, app bootup handles this so its seems erroneous to do this again.
When you run ./AppRun and it starts showing stuff in the terminal window - nothing shows in terms of error logs aside from the error you showed already about prisma?

Then in .env add an env named DATABASE_URL and have it set to the absolute path to the anythingllm.db file that is currently empty and re-run the two prisma commands. Again, app bootup handles this so its seems erroneous to do this again.
When you run ./AppRun and it starts showing stuff in the terminal window - nothing shows in terms of error logs aside from the error you showed already about prisma?

Ok, I have fix that problem, but in a weird way.
You mentioned add DATABASE_URL to the .env, but when i try to do so, terminal shows it still can't find the DATABASE_URL.
So I choose to manually change the url in squashfs-root/resources/backend/prisma/schema.prisma, i replaced env('DATABASE_URL') to the absolut path of anythingllm.db
Now, i can create a workspace without bug. But I don't get it yet.
This is the terminal information now(AnythingLLM works fine)

Do you have openssl installed? Most distros have it pre-installed since nearly everything uses it.

Installed for sure.

@timothycarambat
same error here on debian12 KDE and similar pbl.  on docker on a remote LLM-server.
any bug-fixes yet?
openssl   3.0.11-1~deb12u2  is the latest version in debian stable
additionally I get this console output:
$ AnythingLLMDesktop.appimage
[Preferences] preference config stored at /home/guenter/.config/anythingllm-desktop/config.json
Prisma schema loaded from prisma/schema.prisma
Datasource "db": SQLite database "anythingllm.db" at "file:/home/guenter/.config/anythingllm-desktop/storage/anythingllm.db"

Error: Schema engine exited. Error: Could not find schema-engine binary. Searched in:
-<EMAIL_ADDRESS>- /tmp/.mount_AnythiQ2N2Uw/resources/backend/node_modules/prisma/schema-engine-debian-openssl-1.1.x
- /tmp/.mount_AnythiQ2N2Uw/resources/backend/node_modules/schema-engine-debian-openssl-1.1.x
- /tmp/.mount_AnythiQ2N2Uw/resources/backend/node_modules/prisma/runtime/schema-engine-debian-openssl-1.1.x
Prisma schema loaded from prisma/schema.prisma
Error:
EROFS: read-only file system, unlink '/tmp/.mount_AnythiQ2N2Uw/resources/backend/node_modules/.prisma/client/index.js'

and this error-msg in the app:
Error: Invalid `prisma.workspaces.create()` invocation: Prisma Client could not locate the Query Engine for runtime "debian-openssl-1.1.x". This happened because Prisma Client was generated for "debian-openssl-3.0.x", but the actual deployment required "debian-openssl-1.1.x". Add "debian-openssl-1.1.x" to `binaryTargets` in the "schema.prisma" file and run `prisma generate` after saving it: generator client { provider = "prisma-client-js" binaryTargets = ["native", "debian-openssl-1.1.x"] } The following locations have been searched: /tmp/.mount_AnythiQ2N2Uw/resources/backend/node_modules/.prisma/client /tmp/.mount_AnythiQ2N2Uw/resources/backend/node_modules/@prisma/client /home/tim/Documents/anything-llm-desktop/anything-llm/server/node_modules/@prisma/client /tmp/prisma-engines /tmp/.mount_AnythiQ2N2Uw/resources/backend/prisma

I am running AnythingLLM on a Microsoft Surface 7 ARM64 machine and am getting the same message: "Error: Invalid prisma.workspaces.create() invocation: The table main.workspaces does not exist in the current database."  I have read this and Issue #1077 and they all relate to Linux.  How do I fix this on Windows 11 on ARM64?


Test if email address is used to sign in to Docker hub?

Would it be with testing if an email address is used for the docker hub signin and poping up an error message.  I see weekly someone having issues with this. :panda_face:

@hellonearthis we didn't use to allow signing via email and a PR was merged to do so.
We could disable it for the time being, but it serves as a good reminder to get hub status on the issue.
If Hub allows you to login via email, it should also allow you to pull images with the email.

Yes, having the Hub accept email or username would be the best solution.

Email login was disabled in #3229 . I'm wondering if this still is an issue? Or what the issue is exactly...

@mhelmetag this is why we had added login via email, since hub allowed it - Behind the scene there is a conversion of the username, which kitematic doesn't have. Disabling the login via email is ok for now. Ideally we would either swap out the user after login, or hub allows pulling via email.

@FrenchBen , oh! That makes so much sense. Cool! Good to know what would be needed to re-implement the email login feature.


HA update 2022.3 breaks eforsyning

error in log:
Setup failed for eforsyning: Requirements for eforsyning not found: ['requests==2.22.0'].
2022-03-03 06:48:27 ERROR (SyncWorker_1) [homeassistant.util.package] Unable to install package requests==2.22.0: ERROR: Cannot install requests==2.22.0 because these package versions have conflicting dependencies. ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts 2022-03-03 06:48:27 INFO (SyncWorker_3) [homeassistant.util.package] Attempting install of requests==2.22.0 2022-03-03 06:48:28 ERROR (MainThread) [homeassistant.components.websocket_api.http.connection] [139905641520384] Received invalid command: mobile_app/push_notification_channel 2022-03-03 06:48:28 ERROR (SyncWorker_3) [homeassistant.util.package] Unable to install package requests==2.22.0: ERROR: Cannot install requests==2.22.0 because these package versions have conflicting dependencies. ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts 2022-03-03 06:48:28 INFO (SyncWorker_3) [homeassistant.util.package] Attempting install of requests==2.22.0 2022-03-03 06:48:30 ERROR (SyncWorker_3) [homeassistant.util.package] Unable to install package requests==2.22.0: ERROR: Cannot install requests==2.22.0 because these package versions have conflicting dependencies. ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts 2022-03-03 06:48:30 ERROR (MainThread) [homeassistant.setup] Setup failed for eforsyning: Requirements for eforsyning not found: ['requests==2.22.0'].

Change requests==2.22.0 to 2.27.1 in manifest.json


Copying workspace timeout

https://github.com/smartsheet-platform/smartsheet-csharp-sdk/issues/137

Can talk more as a team, but not 100% sure how we want to handle long running processes. It seems like a thing that can't be fixed in a quick easy way.


Update remotes

PR Checklist

[ ] No API changes were made (or the changes have been approved)
[ ] No major design changes were made (or the changes have been approved)
[ ] Added test (or behavior not changed)
[x] Updated API documentation (or API not changed)
[ ] Added license to new files (if any)
[ ] Added Python wrapping to new files (if any) as described in ITK Software Guide Section 9.5
[ ] Added ITK examples for all new major features (if any)

Windows failure is the flaky JPEG test.


Bug in video prediction?

Now, the model is training with images loaded with PIL but in the video prediction, the images are loaded with CV2, then loaded into PIL, then predict from the image and later convert the result to CV2 again to be shown in the screen.
However, PIL and CV2 use different color spaces. RGB and GBR respectively. So, the model is predicting results from a color space that hasn't be trained with.

No, the reason for using cv2 during video prediction is to create the video playback file.  All the necessary conversions from cv2 to PIL takes place(i.e height and width dimensions are changed)

Is there a color space conversion? From BGR (cv2) to RBG (PIL).
I see that the frame is loaded with cv2, then converted to an array to be loaded by PIL, but it's still in BGR color space when the prediction takes place.

You are right..the color space conversion doesn't takes place...but I don't know whether it affects prediction...it might....I changed all the PIL to cv2 code and the result which i get is more or less similar to the result with this color space error

From my experience, the learned model is robust enough to generalize to the BGR color space (thanks to the data augmentation) but the final performance still improves by fixing this bug.

@AlbertoSabater @gouthamvgk this YOLOv3 tutorial may help you:
https://github.com/ultralytics/yolov3/wiki/Train-Custom-Data
The accompanying repository works on MacOS, Windows and Linux, includes multigpu and multithreading, performs inference on images, videos, webcams, and an iOS app. It also tests to slightly higher mAPs than darknet, including on the latest YOLOv3-SPP.weights (60.7 COCO mAP), and offers the ability to train custom datasets from scratch to darknet performance, all using PyTorch :)
https://github.com/ultralytics/yolov3

Yea I already saw that repo...i wanted a tf or keras implementation so went for this repo but it seems to have a  lot of bugs, especially in loss calculation

Same here, I chose this repo because of tensorflow.
Is there a bug in the loss calculation? Is there any way to fix it?

Hey buddy:
https://github.com/qqwweee/keras-yolo3/issues/366#issue-419835336
I raised same issue and here is the convert way:
in the while loop:
    return_value, frame = vid.read()
    frame = cv2.cvtColor(frame, cv2.COLOR_BGR2RGB)
    image = Image.fromarray(frame)
    image = yolo.detect_image(image)
    result = np.asarray(image)
    result = cv2.cvtColor(result, cv2.COLOR_RGB2BGR)

As an exchange, please provide the issues about the loss calculation. Many thanks.

You are right..the color space conversion doesn't takes place...but I don't know whether it affects prediction...it might....I changed all the PIL to cv2 code and the result which i get is more or less similar to the result with this color space error

Dude, this bug affects. When I use this repo to detect the traffic light, the color space problem will affect the recognition. For example, if there is a red light, this bug will make it blue or purple-like, and then it will not be recognized as a traffic light coz there is no blue traffic light.
But I didn't meet any problems in the loss calculation, could you please give me some info about it?

As far as I know, there isn't any bug in the loss calculation. The NN is trained properly. You just need to get predictions from the same colorspace that the NN has been trained with.

You are right..the color space conversion doesn't takes place...but I don't know whether it affects prediction...it might....I changed all the PIL to cv2 code and the result which i get is more or less similar to the result with this color space error

Dude, this bug affects. When I use this repo to detect the traffic light, the color space problem will affect the recognition. For example, if there is a red light, this bug will make it blue or purple-like, and then it will not be recognized as a traffic light coz there is no blue traffic light.
But I didn't meet any problems in the loss calculation, could you please give me some info about it?

Since your problem is much dependent on the colorspace it might have a greater effect. For standard datasets I think the model is robust enough

As far as I know, there isn't any bug in the loss calculation. The NN is trained properly. You just need to get predictions from the same colorspace that the NN has been trained with.

If you see the xy coordinate loss it is calculated as binary crossentropy, while it is a continuous value...i think mean squared loss is a better one...i trained it on pascal and changing the loss from binary cross entropy to mean squared loss improved the mAP very much!

Can you provide the code to fix the loss?

Can you provide the code to fix the loss?

xy_loss = object_mask * box_loss_scale * 0.5 * K.square(raw_true_xy-raw_pred[...,0:2])
wh_loss = object_mask * box_loss_scale * 0.5 * K.square(raw_true_wh-raw_pred[...,2:4])
confidence_loss = (4.546*object_mask * K.binary_crossentropy(object_mask, raw_pred[...,4:5], from_logits=True))+ ((1-object_mask) * K.binary_crossentropy(object_mask, raw_pred[...,4:5], from_logits=True) * ignore_mask)
class_loss = object_mask * K.binary_crossentropy(true_class_probs, raw_pred[...,5:], from_logits=True)

4.546 in foreground part of confidence loss is a hyperparameter that you can tune according to dataset

Thanks! How can you tune that hyperparameter?

Thanks! How can you tune that hyperparameter?

It is the value by which foreground loss is scaled so that it is not diminished by the background loss...As the number of objects detected as foreground is very less compared to the background we scale it manually to higher value....the tuning depends on your dataset and type of classes

Hi! I've modified the loss function and I've got a worst mAP. This is the set of losses I got during training.

Then I scaled the class loss, obj_loss and boobj_loss to match the scale of the xy_loss and wh_loss but I the final mAP didn't improve. This is the set of losses I got after this second training:

Any idea about how to tune these parameters?

Hi! I've modified the loss function and I've got a worst mAP. This is the set of losses I got during training.

Then I scaled the class loss, obj_loss and boobj_loss to match the scale of the xy_loss and wh_loss but I the final mAP didn't improve. This is the set of losses I got after this second training:

Any idea about how to tune these parameters?

#xy loss usually takes the greater magnitude but here it is almost null...what kind of dataset are you training?...

#xy loss usually takes the greater magnitude but here it is almost null...what kind of dataset are you training?...

I'm working with this dataset.


ConfigurationManager.AppSettings Context issue

Here is the issue I'm having right now:
var someValueA = ConfigurationManager.AppSettings["Key"];
var elasticClient = new ElasticClient(...);
var someValueB = ConfigurationManager.AppSettings["Key"];
someValueA is the exact value from my web.config/app.config that I am expecting but someValueB is null, which is wired. Any idea?

Hey @JasonStein
Weird indeed, but hard to say what's going on here without more info/context, as I'm not able to reproduce this.  Any chance you could put together a simple console app with the bare minimum that repros this?

Sorry, I'm also not able to reproduce this issue. I have tried both console app and web app. Maybe it is related to other stuff that I am using. However, this issue still happens within my project. Cannot share the original code with you since it's confidential :( If I find out the reason, will let you know. Thanks btw.

NEST does not touch ConfigurationManager at all so I'm not convinced this is a bug on our part. Please reopen this if you feel differently @JasonStein :+1:


Templates should only accept some characters on attributes

There are a few issues with the creation of flows when the names of attributes on a template contain some special characters like for example "space" or ".".
It is necessary to change both the device-manager backend and the GUI to deny this invalid characters when creating or editing the name of the attributes on a template.

This might still require an update on GUI to notify the user of malformed attribute labels


add a retry for creating LeaderTpuService within TpuClient

Problem
If a TpuClient is spun up quickly after a cluster is deployed, sometimes the Leader Schedule is not available. The following error is produced:
RpcError(Error { request: Some(GetSlotLeaders), kind: RpcError(RpcResponseError { code: -32602, message: "Invalid slot range: leader schedule for epoch 6 is unavailable", data: Empty }) })

Summary of Changes
Add a retry and timeout mechanism that try and create the LeaderTpuService

I missed the window to review it before it was submitted. Consider giving people some time to look at your code :P

totally understand. that's on me. will create a new PR addressing your comments

new PR here: https://github.com/anza-xyz/agave/pull/2191


[BrokenLinksH2] Fixed the link path

Fixed the link path

Docs Build status updates of commit 1d80121:
:warning: Validation status: warnings

File
Status
Preview URL
Details

Articles/PartnerDocs/KaizalaManagementPortal.md
:warning:Warning

Details

Articles/PartnerDocs/KaizalaManagementPortal.md

Line 0, Column 0: [Warning: h1-missing - See documentation] H1 is required. Use a single hash (#) followed by a space to create your top-level heading.
Line 1, Column 1: [Warning: title-missing - See documentation] Missing required attribute: 'title'. Add a title string to show in search engine results.
Line 9, Column 1: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Managment%20Portal.png'. Alt text is required for accessibility.
Line 13, Column 130: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Manageability.png'. Alt text is required for accessibility.
Line 13, Column 225: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Analytics.png'. Alt text is required for accessibility.
Line 13, Column 335: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Extensibilty.png'. Alt text is required for accessibility.
Line 13, Column 275: [Warning: hard-coded-locale - See documentation] Link 'https://docs.microsoft.com/en-us/kaizala/connectors/setup' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 17, Column 91: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/IT%20Administrator.PNG'. Alt text is required for accessibility.
Line 1, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.
Line 13, Column 275: [Suggestion: docs-link-absolute - See documentation] Absolute link 'https://docs.microsoft.com/en-us/kaizala/connectors/setup' will be broken in isolated environments. Replace with a relative link.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 9482a15:
:warning: Validation status: warnings

File
Status
Preview URL
Details

Articles/PartnerDocs/KaizalaManagementPortal.md
:warning:Warning

Details

Articles/PartnerDocs/KaizalaManagementPortal.md

Line 0, Column 0: [Warning: h1-missing - See documentation] H1 is required. Use a single hash (#) followed by a space to create your top-level heading.
Line 1, Column 1: [Warning: title-missing - See documentation] Missing required attribute: 'title'. Add a title string to show in search engine results.
Line 9, Column 1: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Managment%20Portal.png'. Alt text is required for accessibility.
Line 13, Column 130: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Manageability.png'. Alt text is required for accessibility.
Line 13, Column 225: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Analytics.png'. Alt text is required for accessibility.
Line 13, Column 303: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/Extensibilty.png'. Alt text is required for accessibility.
Line 17, Column 91: [Warning: alt-text-missing - See documentation] Missing alternate text for image 'Images/IT%20Administrator.PNG'. Alt text is required for accessibility.
Line 1, Column 1: [Suggestion: description-missing - See documentation] Missing required attribute: 'description'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Duplicates #261


Does ManagedIdentity switch only supports system assigned identity?

Hi and thanks for creating this module!
Trying it out locally with tokens and it works as I expect.
When trying it an Azure function app, I get an The remote server returned an error: (400) Bad Request.
The function app is not using a system assigned identity, but instead a user managed identity.
Not being a dev, to me this line looks like it assumes the function has an system assigned identity?
https://github.com/PalmEmanuel/AzBobbyTables/blob/8dfd139660808bbf10b93d84fc1c343a8c4e9b06/source/AzBobbyTables.Core/Helpers.cs#L15
Would it be possible to add support for umi, supplying the client_id as parameter to the URI?
https://learn.microsoft.com/en-us/azure/app-service/overview-managed-identity?toc=%2Fazure%2Fazure-functions%2Ftoc.json&tabs=portal%2Cpowershell#rest-endpoint-reference
Or am I just doing it wrong?

Great catch, absolutely! I think you're right, and it's just something that I missed since I usually run it with system-assigned managed identities.
I'll add it to the list and make sure to fix that 👍

Version 3.1.3 is now out with support for UAMIs, would be happy to hear if it solved your issue @gummigroda :)

Glimmrande, works super.
Thanks for the quick update!


Async-graphql v3

This is a good opportunity. We can change the unreasonable design. If you have any ideas, please let me know. 😁

[x] Use the SimpleObject macro and the InputObject macro at the same time.

#[derive(SimpleObject, InputObject)]
#[graphql(input_name = "MyObjectInput")]
struct MyObject {
    #[graphql(default = 10)]
    a: i32,
    b: bool,
}

[x] Types that are not referenced will be hidden in introspection.

#[derive(SimpleObject)]
struct MyObj {
    a: i32,
}

#[Object]
struct Query {
    #[graphql(visible = false)]
    fn obj(&self) -> MyObj {
        todo!()
    }
}

let schema = Schema::new(Query, EmptyMutation, EmptySubscription);
assert_eq!(
    schema.execute(r#"{ __type(name: "MyObj") { name } }"#).await.into_result().unwrap().data,
    value!({ "__type": null })
);

[x] Make the API of integrations is more consistent.
[X] Remove async-graphql-tide.
[X] Rework validators.

Built-in validator:
struct Query;

#[Object]
impl Query {
    async fn value1(&self, #[graphql(validator(maximum = 10))] n: i32) -> i32 {
        n
    }
}

Custom-validator:
struct MyValidator {
    expect: i32,
}

impl MyValidator {
    pub fn new(n: i32) -> Self {
        MyValidator { expect: n }
    }
}

#[async_trait::async_trait]
impl CustomValidator<i32> for MyValidator {
    async fn check(&self, _ctx: &Context<'_>, value: &i32) -> Result<(), String> {
        if *value == self.expect {
            Ok(())
        } else {
            Err(format!("expect 100, actual {}", value))
        }
    }
}

struct Query;

#[Object]
impl Query {
    async fn value(
        &self,
        #[graphql(validator(custom = "MyValidator::new(100)"))] n: i32,
    ) -> i32 {
        n
    }
}

[x] Rework guards.

#[derive(Eq, PartialEq, Copy, Clone)]
enum Role {
    Admin,
    Guest,
}

pub struct RoleGuard {
    role: Role,
}

impl RoleGuard {
    fn new(role: Role) -> Self {
        Self { role }
    }
}

#[async_trait::async_trait]
impl Guard for RoleGuard {
    async fn check(&self, ctx: &Context<'_>) -> Result<()> {
        if ctx.data_opt::<Role>() == Some(&self.role) {
            Ok(())
        } else {
            Err("Forbidden".into())
        }
    }
}

 #[derive(SimpleObject)]
struct Query {
    #[graphql(guard = "RoleGuard::new(Role::Admin)")]
    value: i32,
}

Use parameters:
struct EqGuard {
    expect: i32,
    actual: i32,
}

impl EqGuard {
    fn new(expect: i32, actual: i32) -> Self {
        Self { expect, actual }
    }
}

#[async_trait::async_trait]
impl Guard for EqGuard {
    async fn check(&self, _ctx: &Context<'_>) -> Result<()> {
        if self.expect != self.actual {
            Err("Forbidden".into())
        } else {
            Ok(())
        }
    }
}

struct Query;

#[Object]
impl Query {
    #[graphql(guard = "EqGuard::new(100, value)")]
    async fn get(&self, value: i32) -> i32 {
        value
    }
}

[x] Update documents.

The only thing I need from the subscription stuff is to be able to extract authorization headers and such from the connection so I can authenticate the subscription.

The only thing I need from the subscription stuff is to be able to extract authorization headers and such from the connection so I can authenticate the subscription.

It's generally a bad idea to rely on reading headers in WebSockets, since browsers have limited support for adding custom headers.
Instead, I'd rely on exchanging authorisation (or other) data on the initial payload.

You really don't want to have tokens accessible to the JS, you put them in HTTP only cookies.

You really don't want to have tokens accessible to the JS, you put them in HTTP only cookies.

That won't work in all scenarios - e.g. if your GraphQL server (and therefore, WS(S) connection) is external to the mechanism that first retrieved and set the HTTP cookie.

It would be nice if I could access the context in the middleware/connection_init
right now I do authentication within them but as I cannot access the context I have to rely on global (database connection to verify the auth token)

That won't work in all scenarios - e.g. if your GraphQL server (and therefore, WS(S) connection) is external to the mechanism that first retrieved and set the HTTP cookie.

That's nice and all, but that's not my situation, so I'd still like to be able to do it :)

That's nice and all, but that's not my situation, so I'd still like to be able to do it :)

Understood. Just some advice for others reading this thread and trying to figure out auth -- a common pain point for GraphQL subscriptions, in my experience.
In either case -- here's how gqlgen exposes the context to middleware (Go).

@meh I'm almost done, there will be everything you want. 🙂

I deleted the integration of tide because it does not support websocket very well.

@meh Here is an example of how to use request headers to create subscription context data. This example is based on poem. Now all web framework integration usage is similar.
Maybe you should try poem, I think it is very easy to use. 🙂
https://github.com/async-graphql/examples/blob/be1508f163311f0ca9ed987c9487fd7d28fac942/poem/token-from-header/src/main.rs#L44

@sunli829 is it me or there's no way to pass state to the on_connection_init callback?
I kind of really need that to fully support authentication through GQL_CONNECTION_INIT.

@meh I have full support for this in Async-graphql v3 and also provide examples.
Poem
https://github.com/async-graphql/examples/blob/ee6e8581f096001820c0d4829fa88c0b85f2f8c1/poem/token-from-header/src/main.rs#L44
Actix-web
https://github.com/async-graphql/examples/blob/ee6e8581f096001820c0d4829fa88c0b85f2f8c1/actix-web/token-from-header/src/main.rs#L40

@meh I have full support for this in Async-graphql v3 and also provide examples.
Poem
https://github.com/async-graphql/examples/blob/ee6e8581f096001820c0d4829fa88c0b85f2f8c1/poem/token-from-header/src/main.rs#L44
Actix-web
https://github.com/async-graphql/examples/blob/ee6e8581f096001820c0d4829fa88c0b85f2f8c1/actix-web/token-from-header/src/main.rs#L40

Yeah, but on_connection_init only takes the JSON value, and nothing else.
I need that function to get access to some additional state (database and such).


next: systemd fails to connect to system bus

This may be causing issues with NetworkManager as well. NetworkManager seems to not be marked as started up (it uses dbus) so it is restarted continuously, messing up networking.
Systemd Version
[    7.659660] systemd[1]: systemd 237 running in system mode. (+PAM -AUDIT +SELINUX -IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP +GCRYPT -GNUTLS -ACL +XZ +LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -P

Other Versions
Welcome to SkiffOS f980293!

Logs
Feb 14 15:30:28 skiff-4c2202a dbus-daemon[317]: [system] Activating systemd to hand-off: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.0' (uid=0 pid=318 comm="/usr/sbin/NetworkManager --no-daemon ")
Feb 14 15:30:28 skiff-4c2202a mount-all.sh[165]: Build date of Wed Feb 14 15:30:24 EST 2018 is newer than internal clock of Sun Jan 28 15:58:20 UTC 2018. Bumping internal clock to build date.
Feb 14 15:30:27 skiff-4c2202a systemd[1]: System is tainted: var-run-bad
Feb 14 15:30:27 skiff-4c2202a systemd[1]: Starting Network Manager...
Feb 14 15:30:27 skiff-4c2202a NetworkManager[318]: <info>  [1518640227.9720] NetworkManager (version 1.10.2) is starting... (for the first time)
Feb 14 15:30:27 skiff-4c2202a NetworkManager[318]: <info>  [1518640227.9724] Read config: /etc/NetworkManager/NetworkManager.conf
Feb 14 15:30:27 skiff-4c2202a NetworkManager[318]: <info>  [1518640227.9998] manager[0xc7f030]: monitoring kernel firmware directory '/lib/firmware'.
Feb 14 15:30:53 skiff-4c2202a NetworkManager[318]: <info>  [1518640253.0313] hostname: hostname: hostnamed not used as proxy creation failed with: Error calling StartServiceByName for org.freedesktop.hostname1: Timeout was reached
Feb 14 15:30:53 skiff-4c2202a dbus-daemon[317]: [system] Failed to activate service 'org.freedesktop.hostname1': timed out (service_start_timeout=25000ms)
Feb 14 15:30:53 skiff-4c2202a NetworkManager[318]: <info>  [1518640253.0317] hostname: hostname changed from (none) to "skiff-4c2202a"
Feb 14 15:30:53 skiff-4c2202a kernel: NET: Registered protocol family 10
Feb 14 15:30:53 skiff-4c2202a dbus-daemon[317]: [system] Failed to activate service 'org.freedesktop.systemd1': timed out (service_start_timeout=25000ms)
Feb 14 15:30:53 skiff-4c2202a NetworkManager[318]: <info>  [1518640253.0331] dns-mgr[0xc77ac8]: init: dns=default, rc-manager=symlink
Feb 14 15:30:53 skiff-4c2202a dbus-daemon[317]: [system] Activating systemd to hand-off: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.0' (uid=0 pid=318 comm="/usr/sbin/NetworkManager --no-daemon ")
Feb 14 15:30:53 skiff-4c2202a NetworkManager[318]: <info>  [1518640253.0355] manager[0xc7f030]: rfkill: WiFi hardware radio set enabled
Feb 14 15:30:53 skiff-4c2202a NetworkManager[318]: <info>  [1518640253.0357] manager[0xc7f030]: rfkill: WWAN hardware radio set enabled
Feb 14 15:31:18 skiff-4c2202a dbus-daemon[317]: [system] Failed to activate service 'org.freedesktop.nm_dispatcher': timed out (service_start_timeout=25000ms)
Feb 14 15:31:18 skiff-4c2202a dbus-daemon[317]: [system] Failed to activate service 'org.freedesktop.systemd1': timed out (service_start_timeout=25000ms)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <error> [1518640278.1544] dispatcher: could not get dispatcher proxy! Error calling StartServiceByName for org.freedesktop.nm_dispatcher: GDBus.Error:org.freedesktop.DBus.Error.TimedOut: Failed to activate service 'org.freedesktop.nm_dispatcher': timed out (service_start_timeout=25000ms)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.1550] settings: loaded plugin keyfile: (c) 2007 - 2016 Red Hat, Inc.  To report bugs please use the NetworkManager mailing list.
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <warn>  [1518640278.1552] settings: could not load plugin 'wifi' from file '/usr/lib/NetworkManager/libnm-settings-plugin-wifi.so': No such file or directory
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.1573] settings: loaded plugin iBFT: (c) 2014 Red Hat, Inc.  To report bugs please use the NetworkManager mailing list. (/usr/lib/NetworkManager/libnm-settings-plugin-ibft.so)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <warn>  [1518640278.1575] settings: could not load plugin 'adsl' from file '/usr/lib/NetworkManager/libnm-settings-plugin-adsl.so': No such file or directory
Feb 14 15:31:18 skiff-4c2202a kernel: IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <warn>  [1518640278.1592] keyfile: error loading connection from file /etc/NetworkManager/system-connections/readme: invalid connection: connection.type: property is missing
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.2562] keyfile: new connection /etc/NetworkManager/system-connections/IP Daily 5G (90291557-93f8-4bae-aaa8-a1c528d32bbc,"IP Daily 5G")
Feb 14 15:31:18 skiff-4c2202a kernel: smsc95xx 1-1.1:1.0 eth0: hardware isn't capable of remote wakeup
Feb 14 15:31:18 skiff-4c2202a kernel: IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3505] keyfile: new connection /etc/NetworkManager/system-connections/IP Daily (90291557-93f8-4bae-aaa8-a1c528d32bbb,"IP Daily")
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3600] manager: rfkill: WiFi enabled by radio killswitch; enabled by state file
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3603] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3604] manager: Networking is enabled by state file
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3608] dhcp-init: default DHCP client 'dhclient' is not available
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3611] dhcp-init: Using DHCP client 'dhcpcd'
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3613] Loaded device plugin: NMBondDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3615] Loaded device plugin: NMBridgeDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3616] Loaded device plugin: NMDummyDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3617] Loaded device plugin: NMEthernetDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3618] Loaded device plugin: NMInfinibandDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3619] Loaded device plugin: NMIPTunnelDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3621] Loaded device plugin: NMMacsecDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3622] Loaded device plugin: NMMacvlanDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3623] Loaded device plugin: NMPppDeviceFactory (internal)
Feb 14 15:31:19 skiff-4c2202a kernel: random: crng init done
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3624] Loaded device plugin: NMTunDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3625] Loaded device plugin: NMVethDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3626] Loaded device plugin: NMVlanDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3627] Loaded device plugin: NMVxlanDeviceFactory (internal)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3648] Loaded device plugin: NMAtmManager (/usr/lib/NetworkManager/libnm-device-plugin-adsl.so)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3671] Loaded device plugin: NMWifiFactory (/usr/lib/NetworkManager/libnm-device-plugin-wifi.so)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3722] device (lo): carrier: link connected
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3776] manager: (lo): new Generic device (/org/freedesktop/NetworkManager/Devices/1)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3884] manager: (eth0): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2)
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.3967] keyfile: add connection in-memory (27c3fad5-1367-335c-905b-5df61bc50c1d,"Wired connection 1")
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.4001] settings: (eth0): created default wired connection 'Wired connection 1'
Feb 14 15:31:18 skiff-4c2202a NetworkManager[318]: <info>  [1518640278.4086] device (eth0): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external')
Feb 14 15:31:23 skiff-4c2202a NetworkManager[318]: <info>  [1518640283.5457] manager: startup complete
Feb 14 15:31:58 skiff-4c2202a systemd[1]: NetworkManager.service: Start operation timed out. Terminating.
Feb 14 15:31:58 skiff-4c2202a NetworkManager[318]: <info>  [1518640318.1074] caught SIGTERM, shutting down normally.
Feb 14 15:31:58 skiff-4c2202a NetworkManager[318]: <info>  [1518640318.1172] exiting (success)
Feb 14 15:31:58 skiff-4c2202a systemd[1]: NetworkManager.service: Failed with result 'timeout'.
Feb 14 15:31:58 skiff-4c2202a systemd[1]: Failed to start Network Manager.
Feb 14 15:31:58 skiff-4c2202a systemd[1]: Reached target Network.
Feb 14 15:31:58 skiff-4c2202a systemd[1]: Starting Permit User Sessions...
Feb 14 15:31:58 skiff-4c2202a systemd[1]: Reached target Network is Online.
Feb 14 15:31:59 skiff-4c2202a NetworkManager[417]: <info>  [1518640319.1123] NetworkManager (version 1.10.2) is starting... (after a restart)
Feb 14 15:31:59 skiff-4c2202a dbus-daemon[317]: [system] Activating systemd to hand-off: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.2' (uid=0 pid=417 comm="/usr/sbin/NetworkManager --no-daemon ")
Feb 14 15:31:59 skiff-4c2202a NetworkManager[417]: <info>  [1518640319.1126] Read config: /etc/NetworkManager/NetworkManager.conf
Feb 14 15:32:24 skiff-4c2202a dbus-daemon[317]: [system] Failed to activate service 'org.freedesktop.hostname1': timed out (service_start_timeout=25000ms)
Feb 14 15:32:24 skiff-4c2202a dbus-daemon[317]: [system] Failed to activate service 'org.freedesktop.systemd1': timed out (service_start_timeout=25000ms)
Feb 14 15:32:24 skiff-4c2202a NetworkManager[417]: <info>  [1518640344.1621] hostname: hostname: hostnamed not used as proxy creation failed with: Error calling StartServiceByName for org.freedesktop.hostname1: GDBus.Error:org.freedesktop.DBus.Error.TimedOut: Failed to activate service 'org.freedesktop.hostname1': timed out (service_start_timeout=25000ms)
Feb 14 15:32:24 skiff-4c2202a NetworkManager[417]: <info>  [1518640344.1625] hostname: hostname changed from (none) to "skiff-4c2202a"
...

I found a relevant email from the mailing list:
When I updated systemd from 234 to 237 and D-Bus from 1.12.0 to 1.12.2
on my system with a read-only rootfs (buildroot 1c0c55c028 to buildroot
27d2229692), my D-Bus-activated services stopped working. Checking the
logs, it turned out that systemd PID 1 was not able to connect the D-Bus
socket at all. There were some recent changes in systemd where upstream
refactored code which waits for sockets to appear. However, the real
problem is that systemd is configured to look for the D-Bus socket in
/run/dbus, while D-Bus creates it at /var/run/dbus/. D-Bus upstream
explains in a bugreport [1] that this "traditional" /var/run/dbus is
going to stay because it's hardcoded in other independent
implementations of the D-Bus APIs.

As is also said in that bugreport, the root cause is that /run and
/var/run are effectively two separate directories on Buildroot -- at
least when configured for a R/O rootfs. Furthermore, systemd actually
actively warns about this:

  systemd[1]: System is tainted: var-run-bad

Looking further, systemd-tmpfiles also detects breakage:

  systemd-tmpfiles[172]: [/usr/lib/tmpfiles.d/var.conf:12] Duplicate line for path "/var/run", ignoring.
  systemd-tmpfiles[172]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
  systemd-tmpfiles[172]: [/usr/lib/tmpfiles.d/var.conf:21] Duplicate line for path "/var/lib", ignoring.

This change simply skips /var/run from being copied from the
/usr/share/factory. The symlink is still created by another tmpfiles.d
entry which belongs to systemd.

The other warnings are still in present:

  systemd-tmpfiles[174]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
  systemd-tmpfiles[174]: [/usr/lib/tmpfiles.d/var.conf:21] Duplicate line for path "/var/lib", ignoring.

I'm leaving that one to someone who is more familiar with systemd and
buildroot conventions. My box now boots again, so I'm happy :).

[1] https://bugs.freedesktop.org/show_bug.cgi?id=101628

Signed-off-by: Jan Kundrát<EMAIL_ADDRESS>---

[   15.821143] systemd[1]: System is tainted: var-run-bad
[   15.850847] systemd[1]: Started D-Bus System Message Bus.
[   15.880658] systemd[1]: Failed to connect to system bus: No such file or directory
[   15.910663] systemd[1]: Failed to initialize D-Bus connection: No such file or directory

After applying the patch: Unfortunately, it seems the problem is
still occurring. Maybe it's a different problem?
[   16.650294] systemd[1]: System is tainted: var-run-bad
[   16.680724] systemd[1]: Starting Network Connectivity...
[   16.710421] systemd[1]: Started D-Bus System Message Bus.
[   16.740678] systemd[1]: Failed to connect to system bus: No such file or directory
[   16.770425] systemd[1]: Failed to initialize D-Bus connection: No such file or directory
[   16.800386] systemd[1]: Starting Network Manager...
[1518648890.7497] hostname: hostname: hostnamed not used as proxy creation failed
[   39.020736] dbus-daemon[314]: [system] Failed to activate service 'org.freedesktop.systemd1': timed
out
[   39.100451] dbus-daemon[314]: [system] Activating systemd to hand-off: service
name='org.freedesktop.nm
_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.0' (uid=0 pid=315
comm="/u
sr/sbin/NetworkManager --no-daemon ")
[   39.150403] NetworkManager[315]:   [1518648890.7540] manager[0x20ac030]: rfkill: WWAN hardware
ra
It seems that systemd still cannot talk to the system bus.
I can also see this happening if I try to execute systemd-hostnamed:
./systemd-hostnamed
Failed to get system bus connection: No such file or directory
ls /var/run/
NetworkManager  dhcpcd.pid          docker       ifstate   utmp
dbus            dhcpcd.sock         docker.pid   sepermit
dhcpcd          dhcpcd.unpriv.sock  docker.sock  sshd.pid
ls /var/run/dbus
system_bus_socket
ls /run/
blkid   lock  mount     systemd  user  xtables.lock
docker  log   ntpd.pid  udev     utmp
If I link dbus like so:
ln -s /var/run/dbus/ /run/dbus
It seems then that everything works fine.

Fixed

ln -s /run/dbus /var/run/dbus
Fixed it for me on fedora 27. And my hair is now starting to grow back!

@insaner glad to hear it fixed for you, check out Skiff and Buildroot while you're passing by!

Wow, cool! That is definitely something of interest to me! Especially the cross-compiling part.. always something I've had to jump through acrobatic hoops to accomplish. Things like repackaging glib so I can have both the 32bit and 64bit installed side-by-side in Fedora just to compile my kernel into 64bit. Thanks for the heads up, I will be checking it out!

@insaner I'm interested now in developing out the desktop story for Skiff. Having a lightweight, custom tuned kernel for the hardware + a VM engine (KVM) to run the userspace (Windows, Fedora, or more Skiff containers) is by my estimation a better way to build an OS than a heavy core. This is because the lightweight core can be swapped out at runtime without reboot, and can be updated independently from the userspace libraries.
Something that would be cool to look at is customizing Manjaro's "architect" tool to install a micro-system like Skiff. (If anyone is interested in taking a crack at it!)

That does indeed sound amazing, and is something I have thought for at least a decade (if not 2) that it would be amazing to swap out the kernel at runtime.. without breaking anything
Keep me posted.. I have a hard time adopting new technologies (workflow rigidity) but that sounds like a great project and idea!

@insaner I run Skiff now everywhere for everything, Desktop, Laptop, Servers, VMs, embedded systems...


Issue #SB-23284 feature: Widget Implementation

Closing since PR was raised to another branch,  now this is Invalid


build(package): refactoring build scripts with project ref / incremental

Description:
This PR aims to resolve to improve our build scripts, for perf & simplicity both. It have number of changes and aim to satisfy compat as much (non-major-breaking). Still I may able to miss some, requires eye to review changes.
Changes are below:

Use project references / incremental
npm run compile is now default command for daily dev workflow. It uses tsc's incremental and project references, will try to compile minimal changes as much as it can detect.

Simplifying npm scripts for build / package
npm run compile : just run compiler to check build passes
npm run build:package: run postprocess (rollup minify, subpath aliases..) to prepare actual package publish. Don't need to care about complex build steps anymore.

Using top-level package publishing instead of manual build steps
all build outputs are placed under dist/* and now it is expected to publish right away from top-level root of repo.

Subpath alias now generated by scripts (bulid:package)
Previously we articulated structures to lay out top-level of package to be cjs output, and then copy whole src, then manually modify sourcemap url to conform those structures - and cjs output included subpath alias package.json. Now we publish top-level right away, simply generate those alias on-the-fly when package script runs.

dist/esm2015 -> dist/esm
It's preparation of real-esm-module publishing, as it is no longer 2015. it should affect any runtime as we have module / esm2015 points correct entrypoint per each unless someone explicitly do subpath import which is unsupported sceanario.

use files in package.json
It's hard to block lot of files in .npmignore, instead we use package.json's files property to allow pick up what we want to include. This allows we can use dist to emit whatever output we want without clearing before publish as it won't be picked up ever.

emits declarationMap
now editors can navigate to source of types instead of type definition when try to locate definitions.

Since we're doing alpha for 7.0, I think it's good chance we can try these changes to collect feedback if we see any breaking changes need to be fixed before beta / public release.

cc @kolodny

What's being changed (potential breaking changes)

if you're explicitly traversing subpath esm2015, it is changed to esm: it is not supported to traverse subpath directly anyway
scoped package @reactivex/rxjs supposed to be depreacted, as this PR chanegs pkg manifest to use rxjs package name.

Package structure change
This is inner change, shouldn't create user-facing issue, but layout of structure has changed:
*Previous:

cjs was placed as top level, as well as we placed src by copying it. other build outputs are placed under dist.
*Changed:

Now dist contains all build outputs in its subpath, src stays on top as we package on repo root. subpath aliasing (ajax, operators...) are placed on top level as well to preserve current subpath import behavior.


How to specify a user to run the garden container?

hello, i push a app use a docker image i make. but this app need to run the start command by a specicial user, not vcap. and it need to write something to the container. when i run the start command it appear "permission deny". I login to the container find that the user and user group was changed to this:
drwx------ 6 65534 65534 4096 Mar  7 09:44 myuser
-rwxr-xr-x 1 65534 65534  520 Mar  7 10:18 startServer.sh
so i have some questions:

how to change the authority of the directoryand when container start?
how to specify a user to run this container?
the garden container do not allow to write something to file?
is there a document to teach us to make a docker app image to support the diego?

thank you !

Hi @HelloLin - our goal is to eventually support Docker images without the need for any modification.  The largest remaining gap is around support for users and groups -- our goal is to honor the Docker USER directive and create whatever user is specified in the Dockerfile that generated the Docker image.  That should resolve all your issues simultaneously.
However, we have a number of higher priority items at this point but will try to address this as soon as we can.
For now, your best bet is to open up the permissions on your container file system to allow an arbitrary user to successfully launch the application (for example, you may need to change the permissions on the destination file that your script attempts to write to).

@onsi thank you for your answer. in fact, i find there is a struct define for  specify the user when start the container, but default set to vcap or root. so i solve it by adding a script in "/var/vcap/packages/garden-linux/skeleton/setup.sh"
if [ -d "$rootfs_path/mydir/" ]; then
chroot $rootfs_path chown -R vcap:vcap /mydir
fi
in this way i can write to this dir, but, is this a good way to solve this question?,if mydir is big enough, it will take me a long time.
is diego will support  to push a dockerfile to create a app in the feature?
the most important question is when the community will publish the release which eventually support Docker images?
thank you very much.

We want to implement user support comprehensively and correctly.  Your script gets you past the current barrier but is not a long-term solution.
Diego currently supports pushing dockerfiles to create applications.  There are issues around users (as I mentioned) but apart from that you can tell cloud controller you want a docker-based application today.  The CF diego plugin (installation instructions here) has subcommands for pushing docker applications.  You do need to enable diego-docker support in CC (it's turned off by default).
At this point we don't recommend running Docker applications in multi-tenant environments.

thank you for your answer.

@onsi In my Dockerfile I added a line to create the VCAP user as 0:0 (root)
RUN useradd -R / -m -s /bin/bash -ou 0 -g 0 vcap
2015-03-30T12:37:23.03-0700 [APP/0]      OUT uid=0(root) gid=0(root) groups=0(root),65534(nogroup)
2015-03-30T12:37:23.03-0700 [APP/0]      OUT root

which seemed to work but, starting a script from within the container (image) I am unable to start nginx?  Can I elevate the VCAP event more? How are the processes run?


IOT not showing in wallet even though helium tracker and geek shows the hotspot has earned IOT

IOT is not showing as claimable in the wallet against hotsopts in this case Wild Chambray Octopus.
as per screen shots, IOT is not showing as claimable in the wallet against the name WILD CHAMBRAY OCTOPUS although helium tracker and others are showing the hotspot earned 450 iot average a day as per the screen shots, the helium tracker screen shot is a total for the last 10 days of iot for the single hotspot but as you see next to the name the amount is empty.
THE APP is the latest app of 03rd May 2023 and i have logged out and back in
the SWAPPED HNT to iot then back to HNT was done to show people how to SWAP HNT TO IOT AND visa versa. and no IOT has been claimed for a number of days

as of today 18th May. according to helium tracker a single unit earned 6.9 k of IOT yet on the wallet only 4.8 is claimable. this seems to be happening to a number of our units across the board across different wallets as we have 51 hotspots connected currently. if this continues at this rate currently over the next year there is a 100k difference between claimable and earned for a single hotspot in the year.

@Australian-Hnt-collectors Is this still an ongoing issue?

@Australian-Hnt-collectors Is this still an ongoing issue?

for many people yes it is But this will be another we cannot replicate it even though the Australian test house has the same issues but your answer is Yes still an on going issue


Convert to compatability with ocap-ld?

The ocap-ld proposal is a cryptographically strong syntax for doing basically the same thing we're doing here.
Additional benefits include:

Cryptographic verifiability allow the capabilities to be passed between contexts, and serve as authorizations themselves (currently this module assumes authorization is handled by the message receiver).
A potentially intercompatible format with what will hopefully become an ecosystem of other services.

Downsides:

The proposal is not yet finalized.
There are no implementations I could find of the proposal.
Much more work to implement this.

Format Consideration
If we're going to the trouble of making capabilities cryptographically strong, why not also make them efficient to compute, for blockchain consumption? Could work well with EIP 712, extend my notion of social collateral cash, and potentially evolve into a standard way for expressing EVM-consumible capabilities, which would be more useful to MetaMask (the original intended consumer of this module) and the Ethereum ecosystem in general.
For that reason, JSON may just be a sub-optimal format, and we might want to pursue a binary packed format, that is potentially merkleized also. (I have a similar concern about heavy usage of verifiable-claims in DIDs, being very JSON-dependent in environments where string parsing can sometimes be expensive!).

Cryptographic enforcement belongs at another layer for now. This module assumes pre-authenticated connections.


[MINOR] Add jEnv configuration file to .gitignore

What is this PR for?
Add a new pattern for jEnv configuration file(.java-version) to .gitignore
What type of PR is it?
[Improvement]
Todos

[x] - Add a new pattern to .gitignore

What is the Jira issue?
Minor issue
How should this be tested?
Doesn't affect an actual behavior
Screenshots (if appropriate)
N/A
Questions:

Does the licenses files need update? No
Is there breaking changes for older versions? No
Does this needs documentation? No

LGTM

@zjffdu Wow! You are still so active!!!


VSCODE changes display resolution in Nvidia Surround

Issue Type: Bug

Have a configured mature Nvidia Surround system having no problems with any other application and using a triple 1920x1080 monitor system with bezel correction resulting in what Windows 10 views as a single monitor at 6000x1080 effective resolution.
Start VScode
Observe that the bezel correction has been removed and the entire display is moved to the left causing the icons along the left side to diappear and the start menu, (configured to be on the left side of the desktop) is now inaccessbile.
Observe that typing CTRL-ALT-DEL results in a centered window with the normal options but that the Power icon has disappeared.  The only option available that changes the circumstances is to sign out and then sign back in again, which results in the display returning to normal with proper bezel correction.

 Can you reproduce this with other Electron apps (Teams or Slack) or even Electron itself?


Timeevolution

Don't squash - easier to find out which change caused any speed regressions if it turns out there are any.

Coverage increased (+0.02%) to 98.99% when pulling edeeea622b46f29868fa2845e885e2a02aa4869d on timeevolution into 09091ce49b372c58b06266df587263c9991d0c0d on master.


Add support for running on .NET 7.0

@kant2002 Thanks for your contribution! I'm not sure about the failure in AppVeyor, but it may be that the numbering of builds has changed and some older builds (with higher numbers) need to be removed from MyGet. I'll take a look at that.
I'd actually prefer to fix this problem once and for all rather than continuing to add new lines in Runners.cs. This was done for nunit/nunit-console#1179 and should be replicated for the testcentric engine as well. I'm splitting time between the two projects and haven't had time to do that.
We can go two ways on this PR. If you're willing and have time to port the above PR to testcentric, that would be great. However, if you prefer, I can merge this once the CI problem is fixed and we can wait until someone has time do the more complete fix.

@kant2002 Waiting to hear which way you'd like to go on this.

@CharliePoole Can we go fast way first. I would try properly fix issue, but I have to allocate some time. I find this issue during evaluation of the TestCentric, so proper fix was out of scope, but I understand why do you want proper fix.

Sure... I'll merge this after I fix the CI build and the gui alpha5 release will include it. I'll also add a new issue for the proper fix.

This was a real can of worms! I'll summarize the problems for future reference.

Because multiple packages are involved and all are in the development stage, I have to manually maintain the exact versions to be referenced. I had forgotten to pin the version in use and it was automatically deleted.

Testcentric-engine is now using the latest nunit api dev package, 4.0.0-dev00102, which I will pin.

However, that package had a change adding a property to RuntimeFrameworkService. I have temporarily added the property with an exception being thrown, since we don't actually use it right now.

Moreover, some of the extensions used in our CI testing also were using the same, obsolete build of the API. So I have temporarily eliminated those tests from the build. This includes extensions NUnitProjectLoader, Net20PluggableAgent and NetCore21Pluggable agent.

With all the above in place, the PR was able to pass its tests and is now merged.

I'll create issues for removing these temporary fixes in favor of more robust changes.


Implement a model serving framework

as @tqchen suggested in https://github.com/soumith/convnet-benchmarks/issues/101#issuecomment-210551464 to compete with https://github.com/tensorflow/serving.

Hi there, one of our contributors pointed me to this issue. We're https://github.com/beniz/deepdetect with support for Caffe, and a branch for TF.
To be very much honest, mxnet is not on our roadmap because functionalities would be redundant with that of Caffe. TF was brought in because of LSTM/RNN (that is now in Caffe however), and because it would have to be maintained.
Now, if someone is interested in taking the token, bringing mxnet support to deepdetect would be fairly easy (honestly, can't be worth than Caffe or TF :) ), and we'll provide help on how to achieve this. Ring us as needed if this sounds like a good thing to work on.

@futurely @piiswrong a straightforward way to deploy mxnet models into production environments would indeed be highly welcome.
I have made some very good experience with an open source API server called Deepdetect (http://www.deepdetect.com/, https://github.com/beniz/deepdetect) which I am using heavily to deploy models for my commercial production environments. Currently it is supporting Caffe and XGBoost with partial support for Tensorflow on its way (my experience so far only relates to using Caffe). Would this be a route to go down for mxnet?

@futurely  @revilokeb @piiswrong Hey guys,
Where did you end up with this? Model serving and management is an area of focus for me, and I'd be keen to spend some dev hours on a compatible solution

No one is doing it yet. An easy solution is to use AWS Lambda but it doesn't support GPU and doesn't do batching.
You are welcome to work on it. Please propose a design and we can discuss it

@jordan-green you may be interested in opening an issue for mxnet prediction support with https://github.com/beniz/deepdetect as it already has support for Caffe, XGBoost and Tensorflow. It may not be executed immediately, though not too difficult I believe. If you can help a bit with it, it is even better and will happen faster.

Excited to see this!!

Hi all, my current gut feeling is that this piece of functionality may be best provided as a standalone project, under a compatible and permissive license (most likely apache), so as to benefit other frameworks also.
It would seem that outside of TF Serving, there's not a lot out there. Deep Detect looks interesting @beniz, however it appears to be under the GPL license - can you please confirm?
Lambda / OpenWhisk
Lambda would almost certainly be a great option if it had GPU support, and Amazon will almost certainly provide this in the near future, whether via a different class of lambda or via their new elastic GPU offering (which may be slightly less suited here than the prior). This if of course not an open source solution, and as such may not be the ideal. This had me thinking about other options for implementing a simple, server-less method for hosting inference models, and I think OpenWhisk may suit here.
GPU Compatibility
I can't find validation that it works on GPUs, however their generic action invocation appears to run an arbitrary binary via Alpine Linux, which I've used with cuda in the past with some success. I'll spin up an OpenWhisk VM on my GPU box and report back as to whether or not GPUs are accessible, however it's not immediately obvious to me why it shouldn't be.
Simplification
From there, I think making use of the amalgamation script/s within Mxnet  to provide a simple 'runnable' object may be a good approach to providing a simple deployment process to users. This will obviously need performance testing.
Mxnet Integration
I think this could prove to be a powerful tool for many ML frameworks, with MxNet serving as the foundation in places. Perhaps this would best be its own project/repository, mirrored within and closely integrating with Mxnet? Thoughts on this are much appreciated.
Please let me know your thoughts, and once I've validated some of the moving pieces, particuarly GPU support on OpenWhisk, I'll knock together a design proposal for further discussion.

DD is under LGPL, please see https://github.com/beniz/deepdetect/blob/master/COPYING.

@kevinthesun

@yuruofeifei and I are working on MXNet Model serving. It's still in early stage. In current phase, it creates a http end point and allows developers to fully customize their preprocess and post process function for inference. In the future stage, more powerful functions will be added.
https://github.com/yuruofeifei/mms


Impossible to generate mandate pdf in other language

It does not seem possible to generate mandate PDF in other language.
https://developer.gocardless.com/api-reference/#mandate-pdfs-create-a-mandate-pdf
In Python, it is possible to do the following:
client.mandate_pdfs.create(params={
  "iban": "FR14BARC20000055779911"
}, headers={
  "Accept-Language": "fr"
})

Is there any possibility to do this with this library?

Thanks for the report! We'll have a fix out for this in the next few days.

Hi!
Could you update the related docs also? https://developer.gocardless.com/api-reference/#helper-endpoints-mandate-pdfs
Thanks.

Yeah, good shout! We've recently updated the docs, so the most recent version should be available shortly.

Are you sure that this is actually working? I tried this but I had to put an empty string as a second parameter for the idempotencyKey. Plus I think you put Accept-Header where It should be Accept-Language.
await client.mandatePdfs.create(
  {
    account_number: "44779911",
    branch_code: "200000",
    country_code: "GB"
  },
  { customHeaders: { "Accept-Header": "fr" } }
);

Ahh, yes you're correct. Pretty careless mistake on my part, so apologies for that. I'll get this fixed up ASAP.

 Thanks for the reactivity.


FFM-8177: adds python sdk 1.1.15 relnotes

Note for @KimberlyFields :

Waiting for peer review > should be merged today.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app


Update Links to parts of the repo in the README

Because we've been rewriting numerous scripts and changing their names, README.md has gone out-of-sync in this repo.  We need to update the links in the README to reflect the current locations of the various files in the directory structure.

I'd like to work on this

@Milind712000 It's yours, go ahead.


Register Service Principal for Sharepoint Online Site

What type of issue is this?
Question
What SharePoint development model, framework, SDK or API is this about?
💥 SharePoint Framework
Target SharePoint environment
SharePoint Online
What browser(s) / client(s) have you tested

[ ] 💥 Internet Explorer
[ ] 💥 Microsoft Edge
[x] 💥 Google Chrome
[ ] 💥 FireFox
[ ] 💥 Safari
[ ] mobile (iOS/iPadOS)
[ ] mobile (Android)
[ ] not applicable
[ ] other (enter in the "Additional environment details" area below)

Additional environment details
No response
Issue description
Hello,
I tried to register a Service Principal to a Sharepoint Site according to https://learn.microsoft.com/en-us/sharepoint/dev/solution-guidance/security-apponly-azureacs

Unfortunately, "Create" results in the following Error Message:
I have Sharepoint Admin and Site Admin Rights.
Can someone help me?
Best regards

Hi @matemsg I have checked the behavior in my environment, and I can still create it. However, please double-check the retirement message and also the information about the setting DisableCustomAppAuthentication on the new tenants

As this functionality is in the retirement process, it might be a good idea to use a different method to achieve the same effect.


Run autofix across the entire solution

Is there a way I can run autofix across the entire solution, let's say I want the this prefix to be applied to all the files in the solution.

Do you mean from a command line, or from within Visual Studio?

I'm interested in this as well, Is it possible to just tell Visual Studio to auto fix an entire file?

@darrensteadman In Visual Studio, this is possible for the current document, project, or even entire solution (already from the very first release of VS with analyzers):

@sharwell Do you know of any oss tools out there that will run code fixers on an entire solution, as a command line tool?

@tiesmaster yes, rubocop a linter for linux simply run rubocop -a and it will autofix all the issues it can, there is also eslint that has a similar ability

@alexandru-calinoiu Thnx for the tips, however, I was talking about tools that allow you to run the Roslyn analyzers/code fixers, as what this project is about.

Why was this closed? The question wasn't answered.

I'm also interested to see something like that the day of light. I believe the Roslyn team(s) are working on something like that, and if it's "Fix most code style violations in the current document with a single click." on the VS 2018 roadmap, then it should be due at the end of the month ;) Though, looking at this issue, I see there is still a lot to do ;)

@IanKemp There is no officially supported mechanism to do that. If you build this repository from source, the StyleCopTester tool may be able to provide some untested/unsupported functionality that looks like this. See #2017.

Any updates on this?


Added vapordev command

Added a vapordev command based on https://github.com/qutheory/vapor/pull/80 but in pure swift

Instead for fresh-... Can we make it like a variadic parameter:
Vapordev clean build run ...

Also we could do pattern matching. So
Vapordev c b r would also work

This proof of concept got out of hand quickly :)

This is fantastic.

:+1: Awesome!


Instances of the same tx.Module have different tree_structure

Bug:
Instances of the same tx.Module have different tree_structure
class T(tx.Module):
  pass

t1 = T()
t2 = T()

jax.tree_structure(t1) == jax.tree_structure(t2)

>>> False

Patch is simple:
diff --git a/treex/module.py b/treex/module.py
index bafcdc9..fb036d7 100644
--- a/treex/module.py
+++ b/treex/module.py
@@ -76,6 +76,7 @@ class Module(Treex, Filters, metaclass=ModuleMeta):
     _training: bool = to.static(True)
     _initialized: bool = to.static(False)
     _frozen: bool = to.static(False)
+    name: str = to.static(False)

     def __init__(self, name: tp.Optional[str] = None):
         self.name = (

Looking a bit further. It seems the bug is actually in Treeo.
The problem is Treeo try to auto-annotate, which create instance-level field_metadata, which are all different for different instances. This causes problems in JIT because passing new instances to a function triggers unnecessary recompiling of the function.
I see two ways to solve the problem:
(1) Do not perform auto-annotation after init call. Instead the user should explicit invoke auto-annotation, with the understanding that the call alters tree_structure
or
(2) Manually annotation all tx classes to ensure a class-level metadata already exist for fields created in init

After some more testing, I found that adding a eq() method to class treeo.types.FieldMetadata solves all the issues.
This seems to be the cleanest solution.

Hey @jiyuuchc!
Not actively maintaining Treex/Treeo but happy to approve a PR + create a new release if you want to send it.


invalid application of 'sizeof' to incomplete type 'arm_compute::NEDepthConcatenateKernel'

When I was building the squeezenet with ACL, I just got a problem as below:
In file included from /home/user/my-toolchains/aarch64-linux-android-4.9/include/c++/4.9.x/memory:81:0,
                 from ./arm_compute/runtime/NEON/INESimpleFunction.h:31,
                 from ./arm_compute/runtime/NEON/functions/NEAbsoluteDifference.h:27,
                 from ./arm_compute/runtime/NEON/NEFunctions.h:28,
                 from neon_squeezenet/neon_squeezenet.cpp:1:
/home/user/my-toolchains/aarch64-linux-android-4.9/include/c++/4.9.x/bits/unique_ptr.h: In instantiation of 'void std::default_delete<_Tp []>::operator()(_Tp*) const [with _Tp = arm_compute::NEDepthConcatenateKernel]':
/home/user/my-toolchains/aarch64-linux-android-4.9/include/c++/4.9.x/bits/unique_ptr.h:484:16:   required from 'std::unique_ptr<_Tp [], _Dp>::~unique_ptr() [with _Tp = arm_compute::NEDepthConcatenateKernel; _Dp = std::default_delete<arm_compute::NEDepthConcatenateKernel []>]'
./arm_compute/runtime/NEON/functions/NEDepthConcatenate.h:44:7:   required from here
/home/user/my-toolchains/aarch64-linux-android-4.9/include/c++/4.9.x/bits/unique_ptr.h:117:22: error: invalid application of 'sizeof' to incomplete type 'arm_compute::NEDepthConcatenateKernel'
  static_assert(sizeof(_Tp)>0,

Is there anyone can give me some advices?

Hi @SunAriesCN, could you please share the build command you use?

Hi @morgolock, just as below:
aarch64-linux-android-g++ neon_squeezenet/neon_squeezenet.cpp -I. -Iinclude -std=c++11 -L./build -larm_compute-static -L. -o neon_squeezenet.exe ./build/utils/Utils.o -static-libstdc++ -pie

In neon_squeezenet.cpp, I just build a squeeznet in it, I think you can recur my problem just with some NEDepthConcatenate declaration. Because I just skip this problem with a header adding to the NEDepthConcatenate.h files. I think there are some flaws inside ComputeLibrary header management. Cloud you mind give me some reason about this issue?

Hi @SunAriesCN,
From the compiler error it seems that you should include arm_compute/core/NEON/NEDepthConcatenateKernel.h in the file neon_squeezenet/neon_squeezenet.cpp.
It seems you include NEFunctions.h in your test, but this header file only brings the declaration of the functions and not the kernels. If you use a kernel in your test you should include it's corresponding header file.

Hi @morgolock,
No, I think it is not friendly with your developer users, they should not care about this detail. Because it just call something about NEDepthConcatenate class, and it's fail inside the NEDepthConcatenate, users do not always want to care about the implementation of NEDepthConcatenate, let alone the NEDepthConcatenateKernel object. So, I hope the API will be more friendly in the future...

Hi @SunAriesCN,
I'm trying to reproduce this error. We'll fix it.
So you don't use NEDepthConcatenateKernel.h at all in your test? You just call to the NEDephConcatenate function?

Hi @morgolock,
Yes, I just want to call the configure and run functions on my test, and I fix this by using your Kernel header into the other header I mentioned above, but it's something inside ComputeLibrary and I'm not sure if it's always work well.

Hi @SunAriesCN
Could you please share the source code showing the call to configure?

Hi @SunAriesCN,
Sorry, I can't share my codes to you because of some restriction. But I think you can recur error with some codes as below:
#include "arm_compute/runtime/NEON/NEFunctions.h"

#include "arm_compute/core/Types.h"
#include "utils/Utils.h"
#include <iostream>
#include <sstream>
#include <fstream>
#include <ostream>
#include <sys/time.h>
#include <map>

;//some tensor init
;//some data intialization
NEDepthConcatenate fire2_concat;

Hi @SunAriesCN
I managed to reproduce the error, thanks for reporting this. We'll fix it.

Closing as this error should be fixed in 17.09 release. Reopen if needed.


Clipboard bugfixes

Fixed a bug when it was possible to drag plugin into clipboard
Fixed a bug where clearing clipboard was closing any open modal vs closing only clipboard modal
Removed possibility to close the clipboard by pressing ESC key (misbehaved with dragndrop)

overall LGTM 👍

@vxsx you probably just need to rebase.

Coverage decreased (-0.004%) to 88.508% when pulling 5066d2b6cb21de10b49bba81d77e5cf50413cdbe on vxsx:bugfix/clipboard-behaviour into d063c45bd0253aa6cc1d1bb5dfea1bd868d89528 on divio:develop.

merging through #5300

Coverage decreased (-5.006%) to 84.388% when pulling bfc6a40d050a9d1737d9fb9f8149dd2d9e211727 on vxsx:bugfix/clipboard-behaviour into c1ae649c0ab400e7fdca7ab3170f70d768e2557c on divio:develop.