How does DeepSpeed implement multi-machine model parallelism?

Hi
How does DeepSpeed implement multi-machine model parallelism, while pytorch only supports single-machine model parallelism.
Is there any other docs about DeepSpeed's model parallelism?

Hi there! DeepSpeed does not implement model parallelism, but it does support models that use it. It's up to the user to implement model parallelism (e.g., a user might use some dist.XXX() communication routines to coordinate forward/backward passes). DeepSpeed just needs an mpu object at initialization to query things process ranks and groups (and world_size) during training.
The difficulty of model parallelism was one major motivation for ZeRO. If you enable ZeRO, you can avoid the need for model parallelism in many cases. For an example, the Megatron-LM tutorial combines Megatron's model parallelism with ZeRO.

@ShadenSmith Got it. Is it because the model parallelism is not efficient or scalable that you study memory optimization, the ZeRO?
I'm new to this field, there is too little material about model parallelism. Can I ask why it is hard to do distributed model parallelism, in which way, inter-machine communication, network splitting, or algorithm level.
And thank you.

There are several trade-offs to consider, so for a full answer let me first recommend this excellent survey on parallelism in deep learning: https://arxiv.org/abs/1802.09941
From a library perspective, it's difficult to provide general model parallelism because it is specific to the user model. Model parallelism certainly has uses such as being more memory scalable than data parallelism such as batch splitting.
ZeRO is a set of complementary optimizations that improve scalability without users having to implement model parallelism. The key idea is that users still provide a model without designing for parallelism and DeepSpeed can facilitate data parallelism and ZeRO to scale to large model and large degrees of parallelism. DeepSpeed has scaled to models with 6 billion parameters using only data parallelism and ZeRO on V100 GPUs. Adding model parallelism via Megatron-LM got DeepSpeed to 100B parameters.
I'd like to note that we are of course not anti-model parallelism. DeepSpeed is meant to work with model parallelism if the user has a model-parallel program. The Megatron tutorial touches on this in more depth.

The Megatron tutorial touches on this in more depth.

The link to The Megatron tutorial is 404, here is a steady link:
https://github.com/microsoft/DeepSpeed/blob/46d2e2872b64ebccb8bf4eb5c8a3a55f9adaaa6c/docs/_tutorials/megatron.md

The Megatron tutorial touches on this in more depth.

The link to The Megatron tutorial is 404, here is a steady link:
https://github.com/microsoft/DeepSpeed/blob/46d2e2872b64ebccb8bf4eb5c8a3a55f9adaaa6c/docs/_tutorials/megatron.md


Line alignment while in a room

Problem:
The separator on the room and on the chat don't align, they're identical sections so they should end identically:

Solution:
Select one size for both and align the lines.

This relates to kofta, which is now dead


How to open .dur file

when i synthesize speech, i get some intermediate synthesis files.
I want to know how to open files like .dur getted form duration_model?

merlin/tools/bin/SPTK-3.9/dmp


Please update structure of CHEBI:48529

Hi Gareth,
Please update the structure of CHEBI:48529, cob(I)inamide, since it does not follow the current ChEBI convention of how to draw these compounds. I have attached the updated structure.
Cheers,
Kristian
CHEBI_48529.txt

Hi Kristian,
Done. Sorry it took so long!
Cheers,
Gareth


Activity data

This package is suitable for my project.
When will the "activity" feature be added to the package?
Thank you.

Wait for one or two days, pls.

https://github.com/teramonagi/fitbitr/pull/10

:+1:


Prevent double authentication while using openqaoa-azure

Description
This PR is for solving issue https://github.com/entropicalabs/openqaoa/issues/233.
Checklist

[x] I have performed a self-review of my code.
[ ] I have commented my code and used numpy-style docstrings
[ ] I have made corresponding updates to the documentation.
[x] My changes generate no new warnings
[ ] I have added/updated tests to make sure bugfix/feature works.
[x] New and existing unit tests pass locally with my changes.

Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?
By running tests locally for openqaoa-azure and openqaoa-core.

@TerraVenil You will need to update this PR with the latest version of dev so that it can pass the relevant unittests. :)

Thats a good point on Authentication Errors. The intention of the Device object is to catch Exception (s) that occur during the authentication process and just return a boolean based on the success of the authentication. The handling of the error would be done by other layers controlling the Device object. This was done to ensure consistency in error handling across the different Devices.
Also, it seems like I'm made a mistake in my initial comment, the new amendment only authenticates iff the Device object has not tried to authenticate before. The booleans provider_connected and qpu_connected change depending on whether certain parts of the authentication process is successful.
It is then more appropriate to note that:

If a Device Object has already tried to be authenticated before passing through to the Backend. Then, there will be no attempt to reauthenticate.

This is an important point to note since in some fringe case where the user authenticates, initializes the Device and runs check_connection, makes some change to the internal attributes to the Device after the fact, then passes that modified Device into the Backend. The Device object will not be reauthenticated.
The main point here would be that we need to let users know that the Device object would need to be recreated or check_connection has to be run again on the same object, if the user is looking to reauthenticate the Device.


Replace links with Docker 1.9 bridge networks

Bazooka used to rely on links to work:

The DB container was linked into the server container
The server container was linked into the web container

This PR proposes to replace these links (which are to be considered a
deprecated and legacy feature in Docker) with the usage of bridge
networks:
bzk service start will create a bzk_net network if it doesn't
exist, and attach the db, server and containers to it for them to be
able to communicate.
The build flow was also modified so that the various build containers
(orchestration, parser, ...) are attached to the same network when
started.
This PR also adds:

a working docker compose config capable of starting bazooka using docker compose
a crowdr config
a capitan config

Note: This PR depends on a proposed PR to go-dockercommand:
https://github.com/bywan/go-dockercommand/pull/13

LGTM :+1: Tested and works fine.
Will need to document installation options


This doesn't help...

Did everything this said to do, and I have the same issue.  Also, one should clarify that "some other properties may need to be set" (something like that).
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cb0476b0-bd59-b76c-b7ea-4483160b7948
Version Independent ID: 52e614c4-4033-f14f-c438-0445b397688e
Content: Fatal Error C1107
Content Source: docs/error-messages/compiler-errors-1/fatal-error-c1107.md
Product: visual-cpp
Technology: cpp-diagnostics
GitHub Login: @corob-msft
Microsoft Alias: corob

@AgoraIOT
Sorry it's giving you trouble. The phrase "you must set certain properties to build your project" should read "you must set the following properties to build your project", in case you assumed that the phrasing implied other, unnamed properties.
In cases where simple edits to project properties aren't sufficient to create a working build, I recommend you create a new version of the project file in VS 2022 from a template, then add the existing source files, verifying that the build succeeds as you go. Source changes may also be needed to use the updated frameworks.

It actually does imply other unnamed properties.  For example /EHc, /Zc:twoPhase- (there is no explanation for that anywhere in Visual Studio, btw), and two others (I think).
It is easy enough to test... just turn on /clr and VS will start complaining about incompatible flags which you'll spend a good 30 minutes to an hour trying to find and set using the Project Setup.
I tried to just get a "Hello World" to run using essentially Console.Writeline via our SDK which provides a Logging feature... this is the code:
int main()
{
Log.Write("Hello World");
}
After I modified everything that Visual Studio complained about in terms of compatibility issues, the linker can't find mscorlib using either LIBPATH or AI - spent another two hours trying to figure out why that did not work - no solution.

@AgoraIOT
Perhaps I misunderstood your scenario. Were you retargeting an older C++/CLI project to VS 2022? Or were you trying to turn a project that was originally a native or console app into a C++/CLI app? The changes required are different, and the C1107 article only describes the first case. We don't expect an error article to cover the second scenario. It would wind up recapitulating a lot of content from the .NET programming with C++/CLI documentation.
The changes recommended for /clr in How to: Convert between various string types may apply. The /EHc flag is redundant under /clr, which implies /EHa. /Zc:twoPhase- is normally only required by old code that relies on Microsoft's previous preprocessor behavior. As far as I know, it isn't implied by /clr except in some library code that may use a static_assert (causing error C2338) to require it.
The location of mscorlib.dll depends on the version of .NET you target. When I create a simple CLR Console App from a template, for example, the External Dependencies folder in Solution Explorer lists the full path to mscorlib.dll as "C:\Program Files (x86)\Reference Assemblies\Microsoft\Framework.NETFramework\v4.7.2\mscorlib.dll". The component is installed by the Visual Studio Installer, just in case your Visual Studio 2022 installation is missing the .NET library component.
This has turned into a support case, and we can't do more. For further questions, I recommend Developer Community. Best of luck with your code.


How does that work for a stepper with gearbox?

Hello,
I have the following steppermotor: https://www.omc-stepperonline.com/nema-17-dual-shaft-stepper-motor-l-39mm-gear-ratio-10-1-high-precision-planetary-gearbox-9-5mm-rear-shaft-length.html
Let's say I like to move the stepper to angle 270
Maybe you can provide a practical example for this specific stepper?
Thanks,
Roy

Hello,
in my case I have used a stepper ( 1.8deg/200 steps ) with a gearbox of 13,734:1. I used setStepsPerRotation(2747) and this works perfectly for me. However, I'm not so sure which value to set for the angle.
The default value for anglePerRotation is 360, which would be equivalent to 200 (full) steps. I would assume that the anglePerRotation stays as 360, but the number of steps to achieve one rotation is multiplied with the gear box ratio.
best regards
Seventh

@roydekleijn the explanation provided by @SeventhDwarf is correct. Does it help you?


Custom font size

Add a location in plugin settings for default (main body) font size. All other sizes can scale according to that font.

Would be great if the font size on the PDF could be adjusted (or the HTML or any other format)

Hey!
You could change any behavior with CSS (See Documentation of Plugin) ;)


Extend grammar to support GET expressions

This pull request extends the grammar defined in grammar.lark to support GET expressions, allowing for the parsing of expressions in the form of GET(CollectionName, <key as string literal>). Additionally, it updates the tests to cover the new grammar functionality.

Grammar Extension:

Adds a new rule for get_expression to match the pattern GET(CollectionName, <key as string literal>).
Modifies the start rule to include get_expression.
Defines CollectionName as a new terminal using a regular expression that matches valid collection names.
Ensures that CollectionName can be followed by a comma and a string literal, either escaped or single-quoted.

Test Updates:

Adds new test cases in tests/test_string_literals.py for parsing GET expressions with both escaped and single-quoted string literals.
Updates the StringTransformer class to handle the transformation of get_expression correctly, extracting the collection name and the key.

For more details, open the Copilot Workspace session.

Adds parser configuration to ignore white spaces and includes new test cases for validation.

Grammar Configuration: Introduces a %ignore WS directive and defines the WS token with a regular expression in grammar.lark. This configuration instructs the parser to ignore white spaces outside of defined tokens.
Test Enhancements: Adds new test cases in tests/test_string_literals.py to verify the parser's ability to ignore white spaces around and within expressions. These tests cover various scenarios including leading, trailing, and mixed white spaces, as well as spaces within get_expression constructs.

For more details, open the Copilot Workspace session.

Renames StringTransformer class to MyEvaluator and updates references in tests/test_string_literals.py.

Class Renaming: Renames the StringTransformer class to MyEvaluator to align with the task requirements.
Test Case Updates: Updates all instances where StringTransformer was referenced to now use MyEvaluator, ensuring that test cases reflect the class name change.
Test Case Removal: Removes the test_whitespace_ignoring function, adhering to the task's directive to drop this specific test case.

For more details, open the Copilot Workspace session.

Adds a method to handle collection_name tokens in MyEvaluator and updates test cases to verify correct processing.

Implements a new method collection_name in MyEvaluator that returns the string value of the collection_name token.
Ensures get_expression method in MyEvaluator correctly extracts and returns collection_name and key from the parsed items.
Updates test_get_expression_parsing to include test cases that verify MyEvaluator processes the collection_name token correctly, ensuring the output matches expected dictionary values containing collection_name and key.

For more details, open the Copilot Workspace session.


Mark DatasetProperty nullable

Coverage remained the same at 27.444% when pulling 355618c7e1b3b3f63415e431ecdaa2f951df1d35 on alyiwang:master into 4c8c150b8d6537c984882362f331f7ae3f6bddac on linkedin:master.


Filter not working on all columns

Hi,
I have followed the instructions and I have checked that index.html contains the filter setting for all columns:
datagrid.editableGrid.filter( $(this).val());
However the filter is working only on name and firstname.


converting the project to TypeScript

I have done the work of converting the project to TypeScript.
after cloning simply run npm i followed by npm run build
you can also run npm run watch which will compile the project while you edit.
I wanted to respect the existing code base and made as few changes as possible to the actual implementation. I did my best to fill in types and referenced the existing soap.d.ts for exposed interfaces. I wanted to minimize the use of the any type, but there were places in the code where adding typings would require additional type guards or rework, so I simply typed them as any.
The conversion to classes did require the reorganization of code, but the implementation itself is largely unaffected. I also retained the file structure with the exception of wsdl.js which, in my opinion, was just too large. I created a sub-directory wsdl and broke out the elements objects into a separate file.
I added tslint for linting and disabled many of the recommended rules, again to minimize impact to the existing implementation. These rules can be enabled in the future if desired.
The TypeScript compilation is currently targeting es3. I wanted to ensure that backwards compatibility was not broken. TypeScript will allow the project to utilize some more modern features of JavaScript while still remaining compatible with older versions of node.
I also added typedoc which generates HTML documentation for the project. You can check that out by running npm run docs
It is currently passing all tests.

Coverage increased (+0.2%) to 93.71% when pulling 59d8cab0138c4561ffc1e50c8c48509ec27dd67b on andygreenegrass:master into f4fd1e755b06d57a4e261e21214770043c9d0ed9 on vpulim:master.

Coverage increased (+0.2%) to 93.71% when pulling 59d8cab0138c4561ffc1e50c8c48509ec27dd67b on andygreenegrass:master into f4fd1e755b06d57a4e261e21214770043c9d0ed9 on vpulim:master.

Coverage increased (+0.2%) to 93.71% when pulling 59d8cab0138c4561ffc1e50c8c48509ec27dd67b on andygreenegrass:master into f4fd1e755b06d57a4e261e21214770043c9d0ed9 on vpulim:master.

Coverage increased (+0.2%) to 93.71% when pulling 59d8cab0138c4561ffc1e50c8c48509ec27dd67b on andygreenegrass:master into f4fd1e755b06d57a4e261e21214770043c9d0ed9 on vpulim:master.

https://www.youtube.com/watch?v=My2FRPA3Gf8

@herom thoughts?  i'm reviewing this, and honestly can't find much about it that i don't agree with.  it will invalidate just about every PR out there right now lol.  but perhaps that's a good thing?  (progress anyone?)
overall i'm very impressed @andygreenegrass , and you basically left all the tests untouched!

This is beyond awesome @andygreenegrass ! 🚀 🥇 I did start a conversion to TypeScript myself but due to new job endeavours I lost focus about it... I think that's really great and much needed in order to get all the things structured and fit for the future! 👍
@jsdevel I think that this should be merged/done as quick as possible and tagged as v1.0.0 🐬 as this is clearly marking a big step forward and we can begin to work with semver as it was intended 😃
What do you think about that?

@herom i could go either way on this.  all the existing tests were untouched, which leads me to believe that it's relatively safe to promote this in the next minor release.  this is mostly refactor/maintenance work.  if we release it as a minor version, we're more likely to find issues with it sooner rather than later, as a lot of users aren't likely to pick up a major bump (unless they have * for the version id and aren't using shrinkwrap or package-lock.json).  my preference would be a minor bump, and then we can release fixes that are reported in patch releases.
my main concern is all the existing prs that are open, but most of those have likely been abandoned by now and would probably benefit from being closed (thinking out loud).

@jsdevel, if the changes are non breaking and client of this package would not have to  change the code, then it make sense to bump the minor version.
If it's major release, then probably you need to maintain two versions.
Rest PRs needs to rebased and do the change according to new one if it's minor release. If major one, then probably target can be changed for existing PRs.

either way, going to merge this.  all existing prs will need to be rebased with the latest, which means all prs are likely in conflict.
@andygreenegrass hit me up if you're ever in phoenix and i'll buy you lunch :joy: thanks again!

i'll need to make some updates to the publish process, but the impact should be minimal

Looks like tests are failing, try increasing the timeout.

@RishikeshDarandale it's actually an issue with coveralls.  they're looking into it

@jsdevel thanks for the merge! I really appreciate the positive responses. I'm a big fan of what you guys have built and I'm looking forward to helping make it even better.


[DO NOT MERGE] Add one bitmap index test case.

What changes were proposed in this pull request?
Add one bitmap index test case.
How was this patch tested?
unit test

Thanks Yue to submit the test case to catch the issue #406. I am analyzing the root cause. Thanks.

Just for lei to debug, so we will not merge this.

IMHO, it's a good test case to merge in order to track either feature dev or performance optimization patch to achieve the expected functionality in the future. Thanks.

close it and @lee-lei will upload this case in his PR


Copyright holder and license

Hi,
Could you please add LICENSE file and put the copyright holder and license inside each file? This way there is no chance of someone stumbling across a piece of code without being exposed to the license.

Done!

Nevermind, just added the LICENSE file


Refactors to keep an instance of the response object on the proxy cla…

…sses. Easier to deal with with common payloads

Nice and clean, looks good to me 👍

As part of this PR I should update the README to reflect the changes


feat(dr): new improved dr restore capability

What this PR does / why we need it:

Adds support for restoring from dual-backups.
Adds a new app release with a Restore resource for E2E tests.
$ diff e2e/kots-release-install e2e/kots-release-install-newdr
Only in e2e/kots-release-install-newdr: backup.yaml
diff --color e2e/kots-release-install/deployment-2.yaml e2e/kots-release-install-newdr/deployment-2.yaml
4a5
>   namespace: my-app
diff --color e2e/kots-release-install/deployment.yaml e2e/kots-release-install-newdr/deployment.yaml
4a5
>   namespace: my-app
diff --color e2e/kots-release-install/kots-app.yaml e2e/kots-release-install-newdr/kots-app.yaml
9a10,11
>   additionalNamespaces:
>     - my-app
11c13
<     - deployment/nginx
---
>     - my-app/deployment/nginx
Only in e2e/kots-release-install-newdr: restore.yaml

Which issue(s) this PR fixes:

Does this PR require a test?

Does this PR require a release note?

Adds improved Disaster Recovery support, as outlined in the docs LINK, with the addition of a Velero Backup and Restore resource.

Does this PR require documentation?

TODO

[sc-116990]


error: Found argument '79' which wasn't expected, or isn't valid in this context

My CML is
fmlrc2 −k 21 59 79 -- --min_dynamic_count 0  -v -t 42 -C 10  comp_msbwt.npy  polished.fasta  Polished.2.fa
The error is
error: Found argument '79' which wasn't expected, or isn't valid in this context
I also tried the default K range and it worked well.
Any suggestions are appreciated.

Hello,
There are a few things wrong with the above syntax:

the specific error you are encountering seems to be cause by a different character that looks like hyphen, e.g.: you have "−k" and you should be using "-k"; I'm not sure what that character is, but it is not registering as a hyphen in the CLI
second, you do not need the "--" unless it is the end of your optional parameters.

If you try again, I believe you will find this this works:
fmlrc2 -k 21 59 79 --min_dynamic_count 0 -v -t 42 -C 10 comp_msbwt.npy polished.fasta Polished.2.fa


New Release

We have to release a fix in order to allow groovy support.
#45 and #46
In order to release a new version we have to migrate our package repository from bintray

FYI: we have to follow a specific process in order to get access to our new artifact repository, you can find more information here:
https://issues.sonatype.org/browse/OSSRH-67181

The 4.1 were pushed manually on the sonatype repositories. Sonatype have been notified and we now have to wait for the sync with maven central to be activated in order to allow the marketplace to reference the new artifact repository

🎉
The 4.1 is now back to the sonarqube marketplace, for the 4.2 I will have to push the version manually as it remains some issue with github action and the GPG key that I cannot figure out for now. But well in order to not lock this version I will release it manually and follow the process to promote this version in the marketplace soon.


hi, I try to run CgvsPhoto, but I got an error

Restore weight from previous session ? (y/N) : N
train ...
Traceback (most recent call last):
File "test_pipeline.py", line 18, in
nb_validation_batch = 40,
File "/home/ubuntu/anaconda2/envs/pyannote/lib/python3.5/site-packages/CGvsPhoto/model.py", line 632, in train
show_filters = show_filters)
File "/home/ubuntu/anaconda2/envs/pyannote/lib/python3.5/site-packages/CGvsPhoto/model.py", line 496, in validation_testing
random_rotate = True)
File "/home/ubuntu/anaconda2/envs/pyannote/lib/python3.5/site-packages/CGvsPhoto/image_loader.py", line 405, in get_batch_validation
data = self.get_next_validation(crop, self.rand_crop, random_flip_flop,random_rotate, verbose=False)
File "/home/ubuntu/anaconda2/envs/pyannote/lib/python3.5/site-packages/CGvsPhoto/image_loader.py", line 389, in get_next_validation
image = image.reshape(self.size, self.size, self.nb_channels)
ValueError: cannot reshape array of size 30000 into shape (100,100,1)

Hi, thank you for reporting this issue.
Did you install the package directly with pip? Because I think it was not up-to-date. If you try to update the package now it should work better.
If not please let me know what is the dimension and type of images you are using (I only tried with JPEG so far) and if to what value you set the parameter 'only_green' in the Model definition.


Yaml header

add something

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: Richasy sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/controls/MarkdownTextBlock.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Jupyter 1.2.0

Add magic notation for new spark and scala versioning. Also spark props in magic might be awesome. (Maybe also truncate etc)

done!


MPI test failures

BCReader and Regridder tests are failing sometimes (but not every time) with an error LoadError: Unable to find compatible target in system image. For example, here. We need to figure out why this is happening and fix it.
seems to be fixed by #501

fixed by #501 (hopefully)


chore(consensus): update handle_state_machine_decision to return InternalInconsistency

This change is

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#2957  👈 (View in Graphite)
#2956
#2955
#2954
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Merge activity

Dec 26, 7:08 AM EST: A user started a stack merge that includes this pull request via Graphite.


How do I get notified when user denies camera permission?

Is there a delegate method that handles this case?

Having the same problem - the permission error is currently unhandled:
https://github.com/twostraws/CodeScanner/blob/main/Sources/CodeScanner/CodeScanner.swift#L172

I would hope this is reported back as one of the ScanError types, but if it isn't let me know!

@twostraws there is no error reported when the user denies camera access on the initial permission request. Subsequent  initializations of the AVCaptureDeviceInput throw an exception with code AVError.Code.applicationIsNotAuthorizedToUseDevice, which correctly filters back up the delegate chain.
You would need to explicitly manage the permission request rather than relying on the implicit request which is generated for you in the AVCaptureDeviceInput initializer. See AVCaptureDevice.authorizationStatus(for:) and AVCaptureDevice.requestAccess(for:completionHandler:). Then, put your setup code behind these requests to cover the initial denial.

The completion now returns an error with .permissionDenied in this case.


Improve operation directives and allow to skip/customise resolvers?

So at the moment our operation directives only operate on results of fields, I think we might want to allow complete customisation of a field
So we can do this now:
@strawberry.directive(
    locations=[DirectiveLocation.FIELD], description="Make string uppercase"
)
def turn_uppercase(value: str):
    return value.upper()

but we could allow something like this:
@strawberry.directive(
    locations=[DirectiveLocation.FIELD], description="Make string uppercase"
)
def turn_uppercase(resolver: Callable[]):
    value = resolver()

    return value.upper()

what do you think @erikwrede @bellini666?

In my mental model, field extensions handle this. This is also why we once talked about allowing field extensions to apply schema directives to the respective fields. I'm not sure about the benefits of merging that into strawberry.directive. In any case, we need to define one clear path to solve such problems.
Either
Field Directive -> Applies Field extension and adds directive to schema
Or
Field Extension -> Can Specify a directive that is added when the extension is added

@erikwrede this is for operation directives 😊

@patrick91 oops, the mentions of field wrongly made me think of field extensions 🤦 . As to this case, I believe we should allow also modifying the resolver & variables.
Speaking of field extensions, maybe we can re-use / unify some of that code as the flow of calling an operation extension would be very similar to that of a field extension.
Regarding the execution timing of directives, there's an important decision to be made:
Post-Individual Resolver Execution: Do we apply the directive immediately after each field's resolver has run? This would mean the directive operates on the output of a single field as soon as it's available. The advantage is that we can modify or utilize the output right away. For example, if a field resolver returns a string and we want to change it to uppercase, the directive can do so immediately after that specific resolver finishes its job.
Post-Subtree Resolution Execution: Or, should we wait until an entire section of the query (a "subtree") has been fully resolved before executing the directive? It allows the directive to consider the larger picture—the collective result of a type and all its nested fields—before making any changes.
The key question here is about timing: do we want to intervene early, field by field, or do we want to wait and have the complete context of a larger part of the graph before we act?
For field extensions / schema directives, the immediate answer for me is Post-Individual Resolver Execution. However, I am unsure wether this is the right way to go for Operation directives. As a user, I would expect such directives to be applied on the actual result I would normally receive. We can for now postpone this decision by just focusing on fields without a selection set, but this will be a discssion we need to have as we grow this feature 😊


Spam Mail Detection Model

Added spam mail model

Review

Nice Job Buddy!!
Share and Star the repo!!
Happy Coding/Contributing :)
Follow My LinkedIn


orchestration-api-server get evicted after a while in the local k3s cluster

The eviction message
Reason:           Evicted
Message:          The node was low on resource: ephemeral-storage. Container orchestration-api-server was using 108Ki, which exceeds its request of 0.

Then the restart is successful because:
Warning  FailedScheduling  10m                    default-scheduler  0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/disk-pressure: }, that the pod didn't tolerate.
  Warning  FailedScheduling  7m48s (x1 over 8m48s)  default-scheduler  0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/disk-pressure: }, that the pod didn't tolerate.

It is more related to k3d, because I can see the following lines in the node log:
 Warning  FreeDiskSpaceFailed   59m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  ImageGCFailed         59m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  FreeDiskSpaceFailed   54m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  ImageGCFailed         54m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  FreeDiskSpaceFailed   49m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  ImageGCFailed         49m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  FreeDiskSpaceFailed   44m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed<PHONE_NUMBER> bytes
  Warning  ImageGCFailed         44m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed<PHONE_NUMBER> bytes
  Warning  FreeDiskSpaceFailed   39m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 253243 bytes
  Warning  ImageGCFailed         39m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 253243 bytes
  Warning  FreeDiskSpaceFailed   34m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed<PHONE_NUMBER> bytes
  Warning  ImageGCFailed         34m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed<PHONE_NUMBER> bytes
  Warning  FreeDiskSpaceFailed   29m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 253243 bytes
  Warning  ImageGCFailed         29m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 253243 bytes
  Warning  FreeDiskSpaceFailed   24m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Warning  ImageGCFailed         24m                  kubelet  failed to garbage collect required amount of images. Wanted to free<PHONE_NUMBER> bytes, but freed 0 bytes
  Normal   NodeHasDiskPressure   24m                  kubelet  Node k3d-ns-server-0 status is now: NodeHasDiskPressure

@n-g I believe this is because the orchestrator asks for an emptydir, but doesn't specify a minimum reservation.

I just released a new orchestrator version which sets a size limit for the empty dirs.
Also: since this bug was originally filed, the situation has improved drastically.
Right now, we use orchestrator only to probe for service readiness which does write files to its disk.
Unlike before, deployments are currently fully driven by the CLI.


Windows compatibility

Crazies like me like to work on windows sometimes.  This pr introduces a few changes to help improve the windows compatibility.

Added a powershell install script and windows install instruction to README

Replaced unicode chatacter → in prompt as it causes problems in
standard windows terminals

created putStrFlush to be used instead of T.putStr, ensure content is
flushed to the console and prompts are displayed in the correct order

replaced use of "rm" with System.Directory removeFile.  Wrapped in a
function deleteFile to continue on error

modify setScriptCommand to do nothing on windows systems

These changes should provide a basic level of support for windows platforms.  There are still some outstanding issues which are not addressed by this change:

The build script feature still only produces a bash script.  It could potentially produce a powershell script as well for windows.

The default background for the powershell console is blue,  the prompt arrow colour is also blue here making it a bit hard to read, perhaps the colour scheme could be adjusted.

The tool still relies on curl to be installed for some functions.  Systems are not guaranteed to have this installed (this potentially affects linux systems as well).  For now I've added it to the prerequisite listing in the README.md, but maybe this download function could be done from the haskell code without requiring an external tool.

Wow! @puhlenbruck thanks for contributing to hs-init :tada:
I haven't looked through the code yet, but I hope to do it as soon as possible.. Anyway, the idea is great, I would like to see this support in the project!

@vrom911 Thanks! Please do let me know if there are any suggestions or changes you would like to see before merging.

@puhlenbruck Regarding other issues you shared:

The build script feature still only produces a bash script.

Well, I guess we don't need to create b script for GHC-8.2.2+, because script doesn't work for this GHC. And this version of GHC already has coloring and can strip folders from output. See relevant issue #27.

Ahh, also about this PR: I think you should also add information to changelog regarding your changes 👍 Because your changes are great 🙂

@puhlenbruck Thanks again for your wonderful contribution! This makes me so happy that hs-init becomes better! :heart:


Problem of Dimension Incompatibility when using Auto-PGD

Describe the bug
A clear and concise description of what the bug is.
Hi there. I've successfully implement the FGM attack to my test set.
But when I turn to Auto-PGD, there seems to have a problem.
Applying Auto-PGD will automatically add one to the dimensionality,
leading to the dimension incompatibility when nn.module is receiving the input.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

The test set is a set of 40 photos with only 1 channel, height of 57 and width of 47.
The model is pretrained, and the prediction on the original set is fine.
But when applying AutoProjectedGradientDescent() method, an error is raised:
"RuntimeError: Expected 4-dimensional input for 4-dimensional weight [32, 1, 5, 5], but got 5-dimensional input of size [1, 40, 1, 57, 47] instead"
I looked into the source code and noted that the corresponding line is
"estimator.predict(x=np.ones(shape=(1, *estimator.input_shape), dtype=np.float32))"
seems it just automatically add a "1" prefix to it.
Is there any way to solve it?
System information (please complete the following information):

macOS 11.2.2
Python 3.8.8
ART version 1.5.2
PyTorch 1.8.0

And as a plus, it's the same when I apply the BrendelBethge attack. I wonder what is the purpose of doing so🧐

Hi @taylover2016 Thank you very much for exploring ART. Could you please provide a reproducible example in a Google Colab notebook?

My first guess would be to take a closer look at the definition of you estimator's input_shape argument.

Well, due to some network conditions, I can't get access to the Google CoLab:(
Can I send the code to you someway? Or maybe I'll upload it to my homepage so it's easier.
Anyway, thx for the reply. It really means a lot.😁

Well, due to some network conditions, I can't get access to the Google CoLab:(
Can I send the code to you someway? Or maybe I'll upload it together with the code for other questions to my homepage so it's easier.
Anyway, thx for the reply. It really means a lot.😁

@taylover2016 Ok, I see. I think you also can share jupyter notebook files here by dragging and dropping them into the comment window below. Otherwise you also can paste the code of the example into the comment window and link an example image or refer to a dataset e.g. ImageNet that I can access to reproduce your results.


Can I use this on an asp.net core web garden (multi processes)

Hi,
Is this safe to use FASTER in a multi processes environment?
I'm looking for something to replace IMemoryCache
Thank you!

Core FASTER is a library that works within the current process (embedded). We are working on remote FASTER that you can access across processes (via TCP). See here: https://github.com/microsoft/FASTER/issues/348


perf convert to c++ and enable -Wcast-align

Why did this come up? Is it just general precaution or was there a bug because of it?

Mostly paranoia over potential alignment issues on arm after https://github.com/PX4/Firmware/issues/11408.


Revert "Delete unused code."

Reverts Homebrew/homebrew-test-bot#355

--ci-upload is still used by linuxbrew-core to upload bottles. Until we find an alternative, I would like to keep this around. As the commit was not atomic and multiple commands have been removed at once, I can't really easily extract only the --ci-upload part.
We have multiple bottle uploads waiting in linuxbrew-core right now, so we need to revert this ASAP. As this is test-bot code and we have the habit to revert broken stuff, I am doing what we often do here: revert :)
We should first split this PR in at least two parts: one to remove jenkins code, and maybe another one to remove --ci-upload when not needed anymore.


SubProcEnv and TRPO issues in traj_segment_generator

I have an environment which TRPO handles perfectly well if I feed in an individual environment. However, if I instead construct a SubProcEnv with multiple instances of this environment, I run into issues in the trajectory segment generator.
Traceback (most recent call last):
File "path/to/file/rl_vector_v0.py", line 119, in <module>
    main()

File "path/to/file/rl_vector_v0.py", line 89, in main
    num_layers = nl, num_hidden = nhl, activation = tf.nn.leaky_relu

File "path/to/file/trpo_mpi.py", line 286, in learn
    seg = seg_gen.__next__()

File "path/to/file/trpo_mpi.py", line 55, in traj_segment_generator
    vpreds[i] = vpred

ValueError: setting an array element with a sequence.

It appears that the trajectory segment generator is not equipped to deal with the vectorized outputs of the vectorized environment.
My script to run TRPO can be distilled to the following:
########################################
# Set up the computational environment
########################################
sess = U.make_session()
sess.__enter__()
# Set environment paramdict

def make_env():
    env = gym.make("MyEnv-v0")
    return env

########################################
# Run TRPO
########################################
vector_env = subproc_vec_env.SubprocVecEnv([make_env, make_env, make_env])

pol_net = build_policy(vector_env, 'mlp', num_layers = nl, num_hidden = nhl,
        activation = tf.nn.leaky_relu)

eps_per_batch = 15
num_iters = 100

pi = trpo_mpi.learn(network='mlp', env=vector_env,
    total_timesteps = N*eps_per_batch*num_iters,
    timesteps_per_batch=N*eps_per_batch,
    num_layers = nl, num_hidden = nhl, activation = tf.nn.leaky_relu
    )

Hi @SBuercklin! This particular TRPO implementation was not written to handle vectorized environments. Instead, if you need multiple environments to be simulated in parallel, you can use MPI workers (so that each worker interacts with one environment, but they all share the gradients and parameter updates by using MpiAdamOptimizer.
To run your script with mpi, you'll need mpi4py package, and use
mpirun -np <num_workers> your_script.py
(Also note that if you are seeding environments deterministically, the seeds need to be different on different workers)
It is likely possible to make TRPO work with vecenvs as well, but I'd recommend using MPI and do not have a timeline for when TRPO-vecenv compatibility.


Extract abort-controller from fetch to core

Motivation
To address #589
Approach
I put the new resource in @effection/core instead of creating a new package
TODOs

[ ] Add typedocs

@cowboyd like this?

@minkimcello looks great! Let's drop in the typedoc, and then I'll update the guides.

@minkimcello guides added 👍🏻


Fatal error: UnsafeMutablePointer.initialize overlapping range

Getting an overlapping issue. Can someone provide me some solution?

I also have that issue when running in Xcode 10 swift4.2. Haven’t done much debugging yet...

@losh11 - Are you not getting this issue with swift 4 version running with xcode 10? I am getting this issue on swift4 xcode 10 as well.
Let me know if you find any solution for this, or if you have any branch working with xcode 10 that will be helpful.
Thanks

Anyone got the solution?

Any solution for this please !!!

Found a solution. I’ll be opening a 2.3.0-dev branch with Xcode and bech32
support soon.
On Mon, 15 Oct 2018 at 19:55, benMohamed<EMAIL_ADDRESS>wrote:

Any solution for this please !!!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/litecoin-foundation/loafwallet-ios/issues/51#issuecomment-429972678,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACfNuqeDyc3jlRaAgFM0VmMGe72EHihGks5ulNoDgaJpZM4W3UGf
.

Thank you @losh11

Closing due to inactivity.


Clean up repository and refactor frontend code.

Description
Until the end of consortia and for the release v24.05 we need to focus on cleaning the repository and also refactoring the frotnend code that is not anymore used.
Acceptance Criteria

[ ] Clean up unnecessary documentation
[ ] Refactor and optimize workflows
[ ] Refactor helm charts
[ ] Remove unused features from the backend

Tasks:

[ ] Remove init.values.sh file
[ ] Update Arc42 to reflect latest changes

Refactoring the frontend code is now not included in scope.

I have refactored the frontend code because of the severe bugs we were having.

Now the bugs are solved in the verification branch for frontend:

Font Reloading Added
Token reloading/refresh when 401 added
Incorrect URL format refactored
Refactored backend service js to more optimized request format with axios.


Enable UDS in the Abstract Namespace

Enables use of Unix Domain Sockets in the Abstract Namespace.
There was an issue for this a long time ago here: #4677 which closed because the issue went stale.
Adopted from PR #21278 by @mheese, which is no longer mergeable.
@markdroth

You'll need to sign the CLA before we can look at this.

@markdroth Done!

I've triggered the tests to run, so we can see if the change introduces any problems.

Thanks! I'll make the changes.
On Thu, Oct 29, 2020 at 1:18 PM Mark D. Roth<EMAIL_ADDRESS>wrote:

@markdroth commented on this pull request.
In src/core/lib/iomgr/parse_address.cc
https://github.com/grpc/grpc/pull/24500#discussion_r514540616:

@@ -56,6 +56,15 @@ bool grpc_parse_unix(const grpc_uri* uri,
if (path_len == maxlen) return false;
un->sun_family = AF_UNIX;
strcpy(un->sun_path, uri->path);

if (un->sun_path[0] == '@') {

Eric, Doug, and I discussed this yesterday and agreed that we'd use a new
URI scheme called unix-abstract for this. The path name for this URI
scheme will be the name of the abstract socket, NOT including the leading
NUL byte. And as per normal URI rules, any character not allowed by
RFC-3986 must be percent-encoded.
@beshaya https://github.com/beshaya, please make the necessary changes
to this PR. Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grpc/grpc/pull/24500#discussion_r514540616, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABM25LP3XMUAU6PQSFJQUALSNHEXVANCNFSM4SY4FPHQ
.

This looks good!  I've triggered the tests to run, so let's see how they look.

There's a trailing 'd' in the URL here that doesn't belong.

Fixed

Okay, I've triggered the tests.  Let's see how they look.

Tests triggered again.

Is this an infra failure? Or did something go wrong in the rebase?
ERROR: An error occurred during the fetch of repository 'remotejdk11_linux':
   java.io.IOException: Error downloading [https://mirror.bazel.build/openjdk/azul-zulu11.2.3-jdk11.0.1/zulu11.2.3-jdk11.0.1-linux_x64.tar.gz] to /root/.cache/bazel/_bazel_root/d2dc70c3d9da3fab488ba0dcbbd35051/external/remotejdk11_linux/zulu11.2.3-jdk11.0.1-linux_x64.tar.gz: Connection reset

The failures so far look like transient failures fetching external dependencies or infrastructure timeouts.  I've re-triggered the failed tests.

I'm going to close and then re-open this to see if that will un-wedge EasyCLA.


Provide additional information to detail pickers

Some detail pickers need additional information aside from the initial value. E.g. values for a dropdown box or placeholders for text fields. The additional information should be defined in detail-definitions.js and usecase-definitions.js.

i think this is done within the pr #2143


Invalid permissions setup for the Rust package

In scope of this PR we are fixing invalid permissions setup for the Rust package. Link to the issue page.

These changes were tested (checked permissions and run rustc) on local machine - everything is working properly.

@dibir-magomedsaygitov are you sure that the link provided in the description is correct?

@dibir-magomedsaygitov are you sure that the link provided in the description is correct?

sorry, updated link to the issue

/azp run ubuntu1604, ubuntu1804


Saving and loading locations

Summary
WIP technical implementation for #9. Saving / loading locations to disk are working.
Debug controls (should be removed before merge, in BP_SavedLocationComponent):

9 to save current location
0 to print current list of saved locations to screen

Author checklist

Tutorial for #9
Has the new tutorial been integrated into the main level? No
Has a new section of the readme been added for this tutorial? No
Have you done a full self-review of the code and blueprints? No
Have you tagged a primary reviewer? Yes
Are there any remaining tasks to do or blocking questions to answer before we can merge this? Yes
[x] Implement UI

Testing plan

Reminders for reviewers
Thank you for taking the time to review this PR. By approving a PR you are taking as much responsibility for these changes as the author. Please keep these points in mind throughout the review process:

Review and run all parts of the test plan on this branch and verify it matches expectations.
Review the code and make sure you do not have any remaining questions or concerns. You should understand why this code change fixes the issue and agree that it's the best approach to doing so.
Review the automated tests and make sure there are no missing tests or edge cases.
When you feel this is ready bump it to a second reviewer or merge.

@xuelongmu UI for saved locations have been added in. The portions you pushed look great, and worked as expected for the UI.

@xuelongmu I pushed an update to to the tutorial to close the menu when you move away from it. Ready for re-review.

Looks good! We'll want to update the tutorial with the close menu functionality.


Postgres accelerator throws error zero-length delimited identifier at or near """" when ingesting data.

Describe the bug
The contents of the file https://public-data.spiceai.org/eth.recent_logs.parquet causes an issue when accelerating into a PostgreSQL accelerator engine.
To Reproduce
Create a spicepod with this content (change the postgres parameters to match your local setup).
version: v1beta1
kind: Spicepod
name: postgres_repro

datasets:
- from: https://public-data.spiceai.org/eth.recent_logs.parquet
  name: logs
  acceleration:
    enabled: true
    engine: postgres
    mode: file
    params:
      pg_host: localhost
      pg_port: 5432
      pg_user: postgres
      pg_pass: {password}
      pg_db: postgres
      pg_sslmode: disable

Observe this error:
2024-07-03T00:38:11.121565Z  INFO runtime: Dataset logs registered (https://public-data.spiceai.org/eth.recent_logs.parquet), acceleration (postgres:file), results cache enabled.
2024-07-03T00:38:11.122703Z  INFO runtime::accelerated_table::refresh_task: Loading data for dataset logs
2024-07-03T00:38:14.942605Z ERROR runtime::accelerated_table::refresh_task: Error adding data for logs: External error: Unable to insert Arrow batch to Postgres table: db error: ERROR: zero-length delimited identifier at or near """"
Expected behavior
The acceleration works.

I also got this error for this Spicepod, so it seems more widespread.
datasets:
- from: https://public-data.spiceai.org/github_eth_addresses.csv
  name: addr
  acceleration:
    enabled: true
    engine: postgres
    mode: file
    params:
      pg_host: localhost
      pg_port: 5432
      pg_user: postgres
      pg_pass: {password}
      pg_db: postgres
      pg_sslmode: disable

Confirmed that the issue is fixed accelerating https://public-data.spiceai.org/eth.recent_logs.parquet and https://public-data.spiceai.org/github_eth_addresses.csv with latest trunk


Update kamon-akka, kamon-bundle, ... to 2.1.5

Updates

io.kamon:kamon-akka
io.kamon:kamon-bundle
io.kamon:kamon-prometheus

from 2.1.4 to 2.1.5.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "io.kamon" } ]

labels: library-update, semver-patch

Codecov Report

Merging #648 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #648   +/-   ##
=======================================
  Coverage   81.38%   81.38%
=======================================
  Files         114      114
  Lines        3873     3873
  Branches       90       90
=======================================
  Hits         3152     3152
  Misses        721      721

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ee7043a...7a09dc6. Read the comment docs.


Best pattern for reading App Roles for an API

Core Library
MSAL.js v2 (@azure/msal-browser)
Core Library Version
2.16.0
Wrapper Library
MSAL Angular (@azure/msal-angular)
Wrapper Library Version
2.0.2
Description
I have successfully configured connected two App's using the azure-tutorial  - Users can login and access_tokens are retrieved right before the first request to my API.
In the tutorial, App Roles are mapped to users/groups for both the SPA and the API.
However, I would like to only register and map the App Roles for the API for easier maintenance of users and their access.
Question
In the SPA. How can I upfront determine what roles the user have for a specific API? This is needed to conditionally hide/show menus and buttons.
Should I immediately request an access_token for my API after the user makes a login?
What if I have multiple API's, should I loop all my connected API's or what would be the best practice? 🤔
MSAL Configuration
No response
Relevant Code Snippets
No response
Identity Provider
Azure AD / MSA
Source
External (Customer)

@Thnslj You can use the roles claim in the idToken to determine what roles the user has. The tutorial shows one example of how to do this here. You can also read more about roles here

@tnorling Thanks for the answer..
Yes I know I can check the idToken. But those roles will be those that are configured on the SPA. Not those that are configured on the API.
If you look in the tutorial, they are adding them both the API and the SPA:
This is done twice:

Are they just different endpoints or do they each have their own distinct applicationId?

Different applicationId's

@Thnslj Looks like you can use the MS Graph API to retrieve user app roles. It's unfortunately not something I'm personally familiar with, if you have questions or issues using the Graph API you can ask the Graph SDK team here

@Thnslj Looks like you can use the MS Graph API to retrieve user app roles. It's unfortunately not something I'm personally familiar with, if you have questions or issues using the Graph API you can ask the Graph SDK team here

Is there any possibility to return object from access token like there is currently for identity token? I mean add something like idTokenClaims but for access token, ie. accessTokenClaims? This will resolve my issues also. I have the same flow in AAD for API and SPA as author, and it's also causes me troubles.

@amaleszewski Access tokens should only be opened by the resource for which it is intended, so unfortunately MSAL.js will not be able to return the access token claims. If this is something you need you should do this on your backend


runelet: load libpal.so in bootstrap

Avoid executing runelet through execve, load libpal.so in bootstrap,
and pass this image data to grandchild runelet to solve the dependency
problem in container environment.
Signed-off-by: Tianjia Zhang<EMAIL_ADDRESS>

Can you merge this two commits together?

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

In addition, move the C codes you added for parsing enclave runtime to rune/libenclave/. You can still refer to a global C variable in go source file in such a way:
/*
extern int foo;
*/
import "C"
import fmt

fun bar() {
    fmt.Println(C.foo)
}

In addition, move the C codes you added for parsing enclave runtime to rune/libenclave/. You can still refer to a global C variable in go source file in such a way:
/*
extern int foo;
*/
import "C"
import fmt

fun bar() {
    fmt.Println(C.foo)
}

This method doesn't work. Unresolved symbols in case of cross-package.


Update README.md - Terminal Integration - ShellOracle

ShellOracle is a new ZSH Line Editor widget that uses Ollama for intelligent shell command generation! Ollama rocks!

hi @djcopley that looks like a fun integration. Thanks for adding it to our list of community integrations and for being an amazing part of this incredible community.

Thanks for the PR!


Add a bot slash command: /contribute

Because

I have created this command to give info to people about contributing to our repositories.
This PR

adds slash command /contribute
outputs instructions on how to get started contributing to our repos

Issue

Closes #XXXXX
Additional Information

our current slash commands don't

Pull Request Requirements

[x] I have thoroughly read and understand The Odin Project Contributing Guide
[x] The title of this PR follows the location of change: brief description of change format, e.g. Callbacks command: Update verbiage
[x] The Because section summarizes the reason for this PR
[x] The This PR section has a bullet point list describing the changes in this PR
[x] If this PR addresses an open issue, it is linked in the Issue section
[ ] If this PR adds new features or functionality, I have added new tests
[ ] If applicable, I have ensured all tests related to any command files included in this PR pass, and/or all snapshots are up to date

Made one update to remove weird mobile rendering


Add environment variable to set the application's appbase

@anurse @BillHiebert @Tratcher
This is needed so that VS can set from where the application should find the web root, views, etc.

Works already APPLICATIONBASE

You mean ASPNET_APPLICATIONBASE

https://github.com/aspnet/Hosting/blob/dev/src/Microsoft.AspNet.Hosting.Abstractions/WebApplicationDefaults.cs#L15-L18

Works already APPLICATIONBASE

Jeez, no need to SHOUT :stuck_out_tongue_closed_eyes:

Yes that ASPNET_APPLICATIONBASE OMG!!!


Spin up a self-hosted analytics tool

Description
Set up a self-hosted instance of Plausible analytics for mento.org.
Acceptance criteria

[ ] We have VM running in Google Cloud
[ ] The VM should locally run all other components required (like database, cache, etc) in Docker
[ ] The VM should run Plausible in Docker
[ ] We have setup a mento.org subdomain for analytics pointing to the VM's external IP

@bowd I have no access to our GCP org, so can't move forward with this. Please give me access when you can.

I'm dropping this because I can't move forward. A new VM(vm-plausible-02) has been created and has the plausible container running. However, I cannot reach it from the internet; I've also checked firewall rules, and all are allowed on port 80. The docs mention setting the baseUrl to the domain we want to monitor, I can't do this either as I cannot get access to manage DNS settings on the domain mento.org. Maybe we can ask cLabs IT for assistance unless someone else wants to pick this up. @bowd @nvtaveras @ole-nov


Install instructions

Replace the readme with information about how to install, actually contain information about the boilerplate and how to edit.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/35854387-install-instructions?utm_campaign=plugin&utm_content=tracker%2F19476668&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F19476668&utm_medium=issues&utm_source=github).

I second that!

It's not their responsibility to teach you how to code. The app is in the standard Electron format/layout and the code is well enough written to be able to step your self through any modifications that you need to make.

@jszaszvari The title of this thread is "Install Instructions" NOT "Teach me How to code".

@jszaszvari The title of this thread is "Install Instructions" NOT "Teach me How to code".

Seems pretty comprehensive to me
Quick Start-
git clone https://github.com/szwacz/electron-boilerplate.git
cd electron-boilerplate
npm install
npm start
Also,
Project Structure, Whats in each folder. How to install the Electron runtime, Starting the actual application, Adding Modules, Unit testing, Making a release...
Not sure what else you need.
I've never done anything with this framework before, and 2 hours later I've go a modified version with the changes I wanted ready to deploy at the company I work for.  Really confused as to where its lacking in instructions.

We are not talking about the electron boilerplate but about this app for rocket chat

Go ask in the IRC channel then, Or take the 10 mins to read through the code to understand what it's doing.
It's written well enough to be able to work out what you need to do.

So every users of rocket chat that have to read the code only to understand how to install that app means that no one can install the app.
I know how to install but I installed rocket chat for my community where they have no knowledge about rocket chat, and I have to say to them "read the code of the app to understand install it"? They will abandon super fast my platform.
We need only a step by step process for the various systems like do the other platform slack inspired.

Then what are you doing in the code repository for one of their many desktop clients if you are just looking to understand how to install the app. ?
They have documentation for TONS of platforms in their docs repository here -  https://github.com/RocketChat/Rocket.Chat.Docs/
How about the Main Project at https://github.com/RocketChat/RocketChat ?

I refer to the desktop app that is in this repo

Here you go -
https://github.com/RocketChat/Rocket.Chat.Docs/tree/master/4. User Guides


ml.net document sentiment-analysis

in this tutorial https://docs.microsoft.com/en-us/dotnet/machine-learning/tutorials/sentiment-analysis#how-the-data-was-prepared

SentimentPrediction is the prediction class used after the model training. It inherits from SentimentData for displaying the SentimentText with the predictions. SentimentPrediction has a single boolean (Sentiment) and a PredictedLabel ColumnName attribute. The Label is used to create and train the model, and it's also used with the split out test dataset to evaluate the model. The PredictedLabel is used during prediction and evaluation. For evaluation, training data, the predicted values, and the model are used.

Mistake occurred or I do not understand?
SentimentPrediction class inherits from SentimentData for displaying the SentimentText with the predictions. it ok, but SentimentPrediction  class has a single boolean (Sentiment) and a PredictedLabel ColumnName attribute. ? if your mean  are SentimentPrediction class Regardless of inheritance the class has Prediction boolean with PredictedLabel ColumnName attribute instead of Sentiment (in SentimentData class). and if we consider inheritance in SentimentPrediction class we have two boolean properties Sentiment with Label ColumnName attribute and Prediction with PredictedLabel ColumnName attribute
Is the text explained right?
edit by @mairaw: added topic details
AB#1530397

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c8e22825-c4ee-5a36-f911-8ad456970ecc
Version Independent ID: ad0bf640-7dfc-1184-077c-358bb14277a7
Content: Tutorial: Analyze website comments - binary classification - ML.NET
Content Source: docs/machine-learning/tutorials/sentiment-analysis.md
Product: dotnet-ml
GitHub Login: @JRAlexander
Microsoft Alias: johalex

Thank you for the feedback @djary. @JRAlexander can you please have a look at the wording of this para, and clarify as needed.


brew info of bottles showed outdated formula URL

[x] are reporting a bug others will be able to reproduce and not asking a question. If you're not sure or want to ask a question do so on our Discourse: https://discourse.brew.sh
[x] ran a brew command and reproduced the problem with multiple formulae? If it's a problem with a single, official formula (not cask) please file this issue at Homebrew/homebrew-core: https://github.com/Homebrew/homebrew-core/issues/new/choose. If it's a brew cask problem please file this issue at https://github.com/Homebrew/homebrew-cask/issues/new/choose. If it's a tap (e.g. Homebrew/homebrew-php) problem please file this issue at the tap.
[x] ran brew update and can still reproduce the problem?
[x] ran brew doctor, fixed all issues and can still reproduce the problem?

$ brew doctor
Your system is ready to brew.

[x] ran brew config and brew doctor and included their output with your issue?

$ brew config
HOMEBREW_VERSION: 1.8.3-4-g7241156
ORIGIN: git@github.com:Homebrew/brew.git
HEAD:<PHONE_NUMBER>3d854256a2f75d09409bc5235b3755
Last commit: 3 days ago
Core tap ORIGIN: git@github.com:Homebrew/brew.git
Core tap HEAD:<PHONE_NUMBER>3d854256a2f75d09409bc5235b3755
Core tap last commit: 3 days ago
HOMEBREW_PREFIX: /usr/local
HOMEBREW_DEV_CMD_RUN: 1
CPU: octa-core 64-bit kabylake
Homebrew Ruby: 2.3.7 => /System/Library/Frameworks/Ruby.framework/Versions/2.3/usr/bin/ruby
Clang: 10.0 build 1000
Git: 2.19.1 => /usr/local/bin/git
Curl: 7.54.0 => /usr/bin/curl
Java: 11.0.1, 1.8.0_192
macOS: 10.14.1-x86_64
CLT: <IP_ADDRESS>.1.1539992718
Xcode: N/A
XQuartz: 2.7.11 => /opt/X11

What you were trying to do (and why)
Running commands of $ brew info <formula>, like$ brew info zsh or $ brew info wget, to get formula URL.
What happened (include command output)

Command output

$ brew info zsh
zsh: stable 5.6.2 (bottled), HEAD
UNIX shell (command interpreter)
https://www.zsh.org/
/usr/local/Cellar/zsh/5.6.2_1 (1,478 files, 12.8MB) *
  Poured from bottle on 2018-10-17 at 14:29:06
From: https://github.com/Homebrew/brew/blob/master/Formula/zsh.rb
==> Dependencies
Required: ncurses ✔
Optional: gdbm ✔, pcre ✔
==> Options
--with-gdbm
        Build with gdbm support
--with-pcre
        Build with pcre support
--with-unicode9
        Build with Unicode 9 character width support
--without-etcdir
        Disable the reading of Zsh rc files in /etc
--HEAD
        Install HEAD version
==> Analytics
install: 54,764 (30 days), 211,054 (90 days), 554,106 (365 days)
install_on_request: 50,351 (30 days), 187,846 (90 days), 483,230 (365 days)
build_error: 0 (30 days)

What you expected to happen
The From session of $ brew info would output formula's correct URL.
The zsh formula for example, should output the URL as From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/zsh.rb, instead of From: https://github.com/Homebrew/brew/blob/master/Formula/zsh.rb.
This is perhaps an leftover of refactoring and/or repository transitition of Homebrew/brew to Homebrew/homebrew-core.
Step-by-step reproduction instructions (by running brew commands)
You may take any formula poured from bottle, zsh for example.
$ brew install zsh
$ brew info zsh

@MikeMcQuaid Sorry for that. I have edited the issue and append the results.

Core tap ORIGIN: git@github.com:Homebrew/brew.git

This is your problem. You need to brew untap homebrew/core; brew tap homebrew/core.

Thanks! I recently updated from macOS 10.13 to 10.14, trying several methods but none works. Sorry for bothering, but is there any way that I can ask for help? The oddity of git remote is blowing my mind.
$ brew untap homebrew/core
Error: untapping homebrew/core is not allowed

$ pwd
/usr/local/Homebrew/Library/Taps/homebrew/homebrew-core
$ git remote -v
origin  git@github.com:Homebrew/brew.git (fetch)
origin  git@github.com:Homebrew/brew.git (push)
$ cat .git/config
[core]
        repositoryformatversion = 0
        filemode = true
        bare = false
        logallrefupdates = true
        ignorecase = true
        precomposeunicode = true
        autocrlf = false
[homebrew]
        private = false
[remote "origin"]
        url = git@github.com:Homebrew/homebrew-core.git
        fetch = +refs/heads/*:refs/remotes/origin/*
[branch "master"]
        remote = origin
        merge = refs/heads/master

rm -rf /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core; brew tap homebrew/core should work.

It works. Thanks!

It works! Thanks!
Mike McQuaid<EMAIL_ADDRESS>于2018年11月23日周五 下午10:13写道：

rm -rf /usr/local/Homebrew/Library/Taps/homebrew/homebrew-core; brew tap
homebrew/core should work.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Homebrew/brew/issues/5336#issuecomment-441250978, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AZrghCaxtML-cVnSKLLp3yAkgCE6noSlks5uyAKXgaJpZM4Yunlx
.

--
李想
同济大学土木工程学院 | 本科生
地下建筑与工程系
地址：上海市四平路1239号同济大学
邮编：200092
电话： (+86) 189-1667-0685 / (+1)<PHONE_NUMBER>
<EMAIL_ADDRESS>Xiang, Li
| College of Civil Engineering, Tongji University | Undergraduate |
| Department of Geotechnical Engineering |
1239 Siping Rd, Shanghai,
SH 200092,
China
TEL: (+86) 189-1667-0685 / (+1)<PHONE_NUMBER>
Email<EMAIL_ADDRESS>


spec: using a markdown linter to pretty things up

[no structural changes to the spec, only formatting]
Most linting suggestions from
https://marketplace.visualstudio.com/items?itemName=DavidAnson.vscode-markdownlint

Most closely matching up code blocks to types from
https://github.com/github/linguist/blob/master/lib/linguist/languages.yml
fixing indentation
double newlines only need single
add newline spacing for headers
mixed use of tabs and spaces
fixing mixed use of code-block vs quote blocks

The next big lint would be having no duplicated headers, like #### On Success: OK, such that it can be a page anchor, but that be a
discussion.
Signed-off-by: Vincent Batts<EMAIL_ADDRESS>

Ideally something could be added as a CI step that ensures the document conforms to some linter. For now, this is fine.


Update CCC to Conditional Compilation doc

What

Update CCC to Conditional Compilation doc
Why

How Tested

Process & policy checklist

[ ] I have updated the project documentation to reflect my changes if necessary.
[ ] I have read the CONTRIBUTING documentation.

Is this a breaking change?

[ ] This change causes current functionality to break.

Change looks good, setting this to merge to cleanup old PRs. We can iterate if there's future changes needed.
cc @PorterNan


Social login Google

What version of UAA are you running?
4.30.0
How are you deploying the UAA?
I am deploying the UAA localy
gradlew run
What did you do?
Hello,
I am following the tutorial google-oidc-provider.md to add google social login.
This is what i add to my uaa.yml:
login:
oauth:
providers:
google:
type: oidc1.0
authUrl: https://accounts.google.com/o/oauth2/auth
tokenUrl: https://oauth2.googleapis.com/token
tokenKeyUrl: https://www.googleapis.com/oauth2/v3/certs
issuer: https://accounts.google.com
redirectUrl:  http://localhost:8080/uaa
scopes:
- openid
- email
linkText: Login with google
showLinkText: true
addShadowUserOnLogin: true
relyingPartyId: ******
relyingPartySecret: ******
skipSslValidation: false
attributeMappings:
user_name: email
and i have created the OAuth client in Google with:
origines : http://localhost:8080
redirect url : http://localhost:8080/login/callback/google
What did you expect to see? What goal are you trying to achieve with the UAA?
I'm trying to log in with google account and be redirected to the uaa homepage
What did you see instead?
I have the error message:

That’s an error.

Error: redirect_uri_mismatch
The redirect URI in the request, http://localhost:8080/login/callback/google, does not match the ones authorized for the OAuth client. To update the authorized redirect URIs, visit: https://console.developers.google.com/apis/******
I have change the url in google and put redirect url http://localhost:8080/uaa/login/callback/google and I was able to login with my google account but when I was redirected to localhost i add this message:
There was an error when authenticating against the external identity provider: I/O error on POST request for "https://oauth2.googleapis.com/token": oauth2.googleapis.com; nested exception is java.net.UnknownHostException: oauth2.googleapis.com
kind regards

@alienx96 Here is some troubleshooting guide for your reference of addressing the redirect uri mismatch issue: https://docs.pivotal.io/p-identity/1-9/gcp/troubleshooting.html

Closing due to inactivity.


Add verfication of checksum for yq binary

Overview
Add checkout verification of yq binary.
Rationale
Verify the yq binary in the runners are correct.
Our e2e test would only test if the yq binary downloaded in the e2e test is correct, but not what the runner downloaded during deployment.
Checklist

[x] The charm style guide was applied
[x] The contributing guide was applied
[x] The changes are compliant with ISD054 - Managing Charm Complexity
[x] The documentation is generated using src-docs
[x] The documentation for charmhub is updated.
[x] The PR is tagged with appropriate label (urgent, trivial, complex)

The integration test/e2e test would test if the checksum downloaded matches.
The e2e test would test if the yq binary is working.

Moved to #149


⚠ Jenkins Plugins Artifactory has degraded performance

In 8eeb020, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1280 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 2d2237a after 15 minutes.


PowerShell Core 6.2.3/7.0.0 failing to install AzureAD module on macOS 10.15

Steps to reproduce
Run command install-module azureadpreview in Terminal after starting PowerShell
Expected behavior
Module installs...
Actual behavior
Module fails to install with the following error:
PackageManagement\Install-Package : Unable to load shared library 'api-ms-win-core-sysinfo-l1-1-0.dll' or one of its dependencies. In order to help diagnose loading problems, consider setting the DYLD_PRINT_LIBRARIES environment variable: dlopen(libapi-ms-win-core-sysinfo-l1-1-0.dll, 1): image not found                At /usr/local/microsoft/powershell/6/Modules/PowerShellGet/PSModule.psm1:9508 char:21

...          $null = PackageManagement\Install-Package @PSBoundParameters

                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

CategoryInfo          : NotSpecified: (Microsoft.PowerShel\u2026lets.InstallPackage:InstallPackage) [Install-Package], Exception
FullyQualifiedErrorId : System.DllNotFoundException,Microsoft.PowerShell.Commands.TestModuleManifestCommand,Microsoft.PowerShell.PackageManagement.Cmdlets.InstallPackage

Environment data
PowerShell 6.2.3 or 7.0.0-preview.4 installed via Home-brew on macOS 10.15 Catalina
Attempting to install latest stable and preview versions of AzureAD module
Can confirm this worked on macOS Mojave 10.14.5

@chrsdrhm please open this issue in https://github.com/Azure/azure-powershell


Questions for categories

Dear scholar, I want to ask you where can i find the 11 different categories for Spatial Graph and 14 different categories for semantic Graph ? Thanks.

Thanks for your interests in this project.
For spatial graph, please refer to #9
For semantic graph, we took the top 14 relations in Visual Genome Dataset.

Thank you very much !


Chore: Add tests on health check for section narrative API

Summary

Run make generate-api to changes in the pipeline API template in the unstructured repo.
Add test on "/healthcheck"
Change tests name from risk_narrative_api to section_narrative_api.

This PR has is doing 3 different things. In the future, please keep in separate PR's.


Updated to 1.19.2 #142

Updated the Mod to 1.19.2, so that it works in the newest Version of Minecraft

#142


Clean db value data and use db function for result calculation

Using db functions for calculations all make this feature far more performant, at least around 5x.
For this to work the db needs to have clean values in the db. The linked PR has a script to clean old values.
An issue is that file the correct number fined will make sure only positive numbers are submitted from now on it does allow commas and periods as thousand separators etc.
How can we handle this?

@Parbhat The db functions does not seem to work with numbers like "100.000.00" or "100.000" etc. it wants plain "100000".
Any suggestion for how to handle this?
A way to clean numbers on the fly before calculation with db function?
Add field validation that force applicants to restrain from using comma and period?

@frjo The error happens not in the db aggregation function like Sum but in the annotate method. We need to change output_field in the Cast function from IntegerField to FloatField. As if a value in the db is "500.00"  (a string), it can not be cast to Integer but can be to FloatField. Tested locally, changing this line fixes the issue.
https://github.com/OpenTechFund/hypha/blob/1975e7d7de47ef731ebe7bcdbb0ece50e63d16cb/hypha/apply/funds/views.py#L1148
It seems better to not change anything in client validation for number input.

@Parbhat Thanks, will test that.
Sent with GitHawk


Simple react app

Is there a simple example of how to use superset in a react app via the provided API?

@michaelgriffithus did you find any example(s)?


TIM-157 feat(layout): add logout functioonality for mobile

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#117  👈
#116
#115
#114
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @xdjeremy and the rest of your teammates on  Graphite


Headings in sequential order

User Story
AS A marketing agency
I WANT a codebase that follows accessibility standards
SO THAT our own site is optimized for search engines

Acceptance Criteria
GIVEN a webpage meets accessibility standards
WHEN I view the heading attributes
THEN they fall in sequential order

headers were used randomly in elements. each heading is used only once in each element, updated all to h1 tags using element and h1 tags to specify formatting.
99fb1fc0d6784d146d04c687e4ebc84c9b5e7114


Unknown column 'NaN' in 'field list'

ERROR :  https://pastebin.com/cGLHUdEm
CODE : https://pastebin.com/9U5EjtBG

Anyone know how debug pool.query ?

:/


[Installation]: Building editable for vllm fails (pip install -e .)

Your current environment
The output of `python collect_env.py`

Collecting environment information...
PyTorch version: 2.1.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04.3 LTS (x86_64)
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: Could not collect
CMake version: Could not collect
Libc version: glibc-2.35

Python version: 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] (64-bit runtime)
Python platform: Linux-5.15.0-97-generic-x86_64-with-glibc2.35
Is CUDA available: True
CUDA runtime version: 12.1.105
CUDA_MODULE_LOADING set to: LAZY
GPU models and configuration: GPU 0: NVIDIA A40
Nvidia driver version: 535.161.07
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      52 bits physical, 57 bits virtual
Byte Order:                         Little Endian
CPU(s):                             96
On-line CPU(s) list:                0-95
Vendor ID:                          GenuineIntel
Model name:                         Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz
CPU family:                         6
Model:                              106
Thread(s) per core:                 2
Core(s) per socket:                 24
Socket(s):                          2
Stepping:                           6
CPU max MHz:                        3500.0000
CPU min MHz:                        800.0000
BogoMIPS:                           5600.00
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 invpcid_single ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local split_lock_detect wbnoinvd dtherm ida arat pln pts avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid fsrm md_clear pconfig flush_l1d arch_capabilities
Virtualization:                     VT-x
L1d cache:                          2.3 MiB (48 instances)
L1i cache:                          1.5 MiB (48 instances)
L2 cache:                           60 MiB (48 instances)
L3 cache:                           72 MiB (2 instances)
NUMA node(s):                       2
NUMA node0 CPU(s):                  0-23,48-71
NUMA node1 CPU(s):                  24-47,72-95
Vulnerability Gather data sampling: Mitigation; Microcode
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass:    Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected

Versions of relevant libraries:
[pip3] numpy==1.26.2
[pip3] nvidia-nccl-cu12==2.18.1
[pip3] torch==2.1.1
[pip3] torchaudio==2.1.1
[pip3] torchvision==0.16.1
[pip3] triton==2.1.0
[conda] Could not collect
ROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: N/A
vLLM Build Flags:
CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled
GPU Topology:
GPU0    NIC0    NIC1    CPU Affinity    NUMA Affinity   GPU NUMA ID
GPU0     X      SYS     SYS     0-23,48-71      0               N/A
NIC0    SYS      X      PIX
NIC1    SYS     PIX      X

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

NIC Legend:

  NIC0: mlx5_0
  NIC1: mlx5_1

How you are installing vllm
This issue is for development with vllm on a RunPod instance using torch=2.1.1 and cuda=12.1.1. When I launch and run this command, it fails. (This is what I run every time I start a pod, first time seeing this issue.)
pip install -e .

The specific error is:
Command '['cmake', '--build', '.', '-j=96', '--target=_moe_C', '--target=_C']' returned non-zero exit status 1.

which causes pip to exit.
In the above output I also see this, don't know if that's related.
FAILED: CMakeFiles/_C.dir/csrc/quantization/cutlass_w8a8/scaled_mm_dq_c3x.cu.o

Last few output lines:
Traceback (most recent call last):
    File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
      main()
    File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
      json_out['return_val'] = hook(**hook_input['kwargs'])
    File "/usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 273, in build_editable
      return hook(wheel_directory, config_settings, metadata_directory)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 443, in build_editable
      return self._build_with_temp_dir(
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 395, in _build_with_temp_dir
      self.run_setup()
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/build_meta.py", line 311, in run_setup
      exec(code, locals())
    File "<string>", line 401, in <module>
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/__init__.py", line 103, in setup
      return distutils.core.setup(**attrs)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/core.py", line 184, in setup
      return run_commands(dist)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/core.py", line 200, in run_commands
      dist.run_commands()
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/dist.py", line 969, in run_commands
      self.run_command(cmd)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/dist.py", line 968, in run_command
      super().run_command(command)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/command/editable_wheel.py", line 155, in run
      self._create_wheel_file(bdist_wheel)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/command/editable_wheel.py", line 357, in _create_wheel_file
      files, mapping = self._run_build_commands(dist_name, unpacked, lib, tmp)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/command/editable_wheel.py", line 280, in _run_build_commands
      self._run_build_subcommands()
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/command/editable_wheel.py", line 307, in _run_build_subcommands
      self.run_command(name)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/cmd.py", line 316, in run_command
      self.distribution.run_command(command)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/dist.py", line 968, in run_command
      super().run_command(command)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/command/build_ext.py", line 91, in run
      _build_ext.run(self)
    File "/tmp/pip-build-env-atlbmard/overlay/local/lib/python3.10/dist-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
      self.build_extensions()
    File "<string>", line 205, in build_extensions
    File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=96', '--target=_moe_C', '--target=_C']' returned non-zero exit status 1.
  error: subprocess-exited-with-error

  × Building editable for vllm (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /usr/bin/python /usr/local/lib/python3.10/dist-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_editable /tmp/tmp0b_o36qi
  cwd: /workspace/vllm
  Building editable for vllm (pyproject.toml) ... error
  ERROR: Failed building editable for vllm
Failed to build vllm
ERROR: Could not build wheels for vllm, which is required to install pyproject.toml-based projects

@felixzhu555 How do you solve this problem? I get the same error when building vllm.

I'm not sure to be honest, try to pull the most recent changes and use torch >=2.2. This issue might've been some issue on RunPod's side, since it disappeared when I started a new pod. Sorry for not having a better answer :(


Tab completion should be API profile aware

Only show completions for the current API profile.

The infrastructure in the CLI already supported this.
Closing issue.


[mgmt] netapp release

https://github.com/Azure/sdk-release-request/issues/4816

breaking caused by https://github.com/Azure/azure-rest-api-specs/pull/26643

API change check
API changes are not detected in this pull request.


GitHashForFiles should care about path if it is abs path

In calculateGlobalHash, There are:
f := globby.GlobFiles(rootpath, globs, []string{})
for _, val := range f {
    globalDeps.Add(val)
}

And
globalFileHashMap, err := fs.GitHashForFiles(globalDeps.UnsafeListOfStrings(), rootpath)

The globalFileHashMap will be used to call GitHashForFiles which:
filepath.Join(PackagePath, filename)

Which may cause incorrect cache match if git object-hash files... failed.

Well. I'm working on a outdated branch.


feat(routes): Renamed @Action decorator to @Route

This project uses semver, please check the scope of this pr:

[ ] #patch# - backwards-compatible bug fix
[x] #minor# - adding functionality in a backwards-compatible manner
[ ] #major# - incompatible API change

BREAKING CHANGE: All imports and instances of @Action need to be renamed to @Route
Example
import { Action } from 'ubiquits/core/server';
[...]
@Action('GET', '.test')
public method()

becomes
import { Route } from 'ubiquits/core/server';
[...]
@Route('GET', '.test')
public method()

Closes #58

Changes Unknown when pulling 8054c10042b41fc24a1d960664f548d7432cf2fa on refactor/route-decorators into ** on master**.


Using custom tag/taggable item models without generic FK fails

develop branch at 91791c87a99dc20a69174a958a388b10e4573860 contains docs on how to use custom models. It sounds like it is possible to avoid using content types and simplify the DB layout. The following code breaks on ModelForm rendering though:
class CustomTag(TagBase):
    description = models.CharField(_('description'), max_length=200)

class CustomTaggedItem(ItemBase):
    tag = models.ForeignKey(CustomTag,
                            related_name="%(app_label)s_%(class)s_items")

class Place(models.Model):
    title = models.CharField(_('description'), max_length=50)
    tags = TaggableManager(through=CustomTaggedItem)

The error is: Cannot resolve keyword u'content_object' into field. Choices are: id, tag. And it is triggered by TaggableManager.value_from_object() -> ItemBase.lookup_kwargs().
Tag lookups fail at another point: TaggableManager.m2m_column_name() triggers CustomTaggedItem has no field named u'content_object' error.
ItemBase obviously has no content_object field, which appears to be hardcoded upper in the hierarchy tree.
Are we expected at least to override lookup_kwargs, tags_for in any ItemBase subclass?

I'm like 95% sure this doesn't exist as a problem naymore given how much custom tagging stuff I've done. Closing for now


Panda tries to access network when it doesn't need to

I ran into this problem while running without a network connection, I'd just ran bootstrap.pl (which worked) and tried to install a local module with no deps (which didn't). It looks like it unconditionally wants to download the json modules list if it doesn't have a local copy yet.

Same problem with 'panda help', as described in #64 (closing it as duplicate).

This should work now :)


Include GCS in health check [GAWB-1962]

deadlocks is built into Dropwizard, it's detecting deadlocked Java threads. Not sure how useful this is for us, but might as well keep it around
Elasticsearch - already implemented
Google storage - attempt to read the directory listing at the root of the bucket

Example output:
{
  "deadlocks" : {
    "healthy" : true
  },
  "elastic-search" : {
    "healthy" : true,
    "message" : "ClusterHealth is GREEN"
  },
  "google-cloud-storage" : {
    "healthy" : true
  }
}

[x] Submitter: Include the JIRA issue number in the PR description
[x] Submitter: Make sure Swagger is updated if API changes
[x] Submitter: Check documentation and code comments. Add explanatory PR comments if helpful.
[x] Submitter: JIRA ticket checks:

Acceptance criteria exists and is met
Note any changes to implementation from the description
Add notes on what you've tested

[x] Submitter: Update RC_XXX release ticket with any config or environment changes necessary
[x] Submitter: Update FISMA documentation if changes to:

Authentication
Authorization
Encryption
Audit trails

[x] Submitter: If you're adding new libraries, sign us up to security updates for them
[x] Tell the tech lead (TL) that the PR exists if they wants to look at it
[ ] Anoint a lead reviewer (LR). Assign PR to LR

Review cycle:

LR reviews
Rest of team may comment on PR at will
LR assigns to submitter for feedback fixes
Submitter rebases to develop again if necessary
Submitter makes further commits. DO NOT SQUASH
Submitter updates documentation as needed
Submitter reassigns to LR for further feedback

[ ] TL sign off
[ ] LR sign off
[ ] Product Owner sign off
[ ] Assign to submitter to finalize
[ ] Submitter: Verify all tests go green, including CI tests
[ ] Submitter: Squash commits and merge to develop
[ ] Submitter: Delete branch after merge
[ ] Submitter: Test this change works on dev environment after deployment. YOU own getting it fixed if dev isn't working for ANY reason!
[ ] Submitter: Verify swagger UI on dev environment still works after deployment
[ ] Submitter: Inform other teams of any API changes via hipchat and/or email
[ ] Submitter: Mark JIRA issue as resolved once this checklist is completed

Coverage decreased (-1.1%) to 67.114% when pulling b3c070cefc474f0b8e0e1fa08ca0df79da1322dd on an-GAWB-1962 into 8145cf89da12b61490d5d461c0b565e25766d856 on develop.

Coverage decreased (-0.5%) to 67.761% when pulling 8f68e32228e1281da35af021aaa62a6b94633da3 on an-GAWB-1962 into 8145cf89da12b61490d5d461c0b565e25766d856 on develop.

Coverage decreased (-1.9%) to 66.274% when pulling 1de124e008a269fecb35be45b9322f3035a7d681 on an-GAWB-1962 into 8145cf89da12b61490d5d461c0b565e25766d856 on develop.

Coverage decreased (-1.4%) to 66.789% when pulling 5c0c1e0f0ec1bf3aa7dff80fca853bebfbbfb39a on an-GAWB-1962 into 8145cf89da12b61490d5d461c0b565e25766d856 on develop.


Fix drop/copy functions for function objects

Signed-off-by: thirdsgames<EMAIL_ADDRESS>

Regression tests should be added before this is merged.


Migrates the start point from Parcel > Webpack

This PR updates the mob programming start point to use Webpack rather than Parcel. It came to light that some Windows users were having problems npm installing as they were running into node-gyp issues.

No issues running this with webpack (I'm on a Mac) but the ReadMe should be updated to remove references to Parcel. The app now runs on port 8080 instead of 1234 as well. 🙂

Thanks @ellie-at-arnoldclark, nice catch! Pushed a further change that:

Removes references to parcel-cache in .gitignore
Removes an un-needed .parcelrc file
Updates the docs to refer to Webpack + the new port


Percentage Point Functions for parameters

This PR adds the Percentage Point Function (PPF) to Enterprise parameters. The PPF is the inverse of the CDF, so it can be used to sample from the distribution. Some Nested Sampling implementations require the PPF as input: for instance MultiNest requires the "hypercube transformation". That is done with the PPF.
Now we can do something like:
from enterprise.signals.parameter import LinearExp

le = LinearExp(1, 3)("LEXP")
le.get_ppf(0.5)

The Truncated Normal PPF is not yet implemented, but LinearExp, Normal, and Uniform are there.

It seems that this requires some extra unit tests. Actually, the unit tests for the entire parameter class do not check for exceptions. I'll just update it to check for everything...

@vhaasteren Is there anything that needs to be done on this one?

No, is ready to go