Usage example for get_output()

Discussed in https://github.com/microsoft/onnxruntime-genai/discussions/522

Originally posted by anutkk May 26, 2024
According to the documentation  generator.get_output() should return the generated logits.
In practice, this is the error message I get:
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In[37], [line 1](vscode-notebook-cell:?execution_count=37&line=1)
----> [1](vscode-notebook-cell:?execution_count=37&line=1) generator.get_output()

TypeError: get_output(): incompatible function arguments. The following argument types are supported:
    1. (self: onnxruntime_genai.onnxruntime_genai.Generator, arg0: str) -> numpy.ndarray

Invoked with: <onnxruntime_genai.onnxruntime_genai.Generator object at 0x7decfe932ff0>

The function expects an input string. However no matter what I put, the output is array([], dtype=float64).
What is the correct way to use this method?

So after digging through the C++ source code, the answer is:
logits=generator.get_output("logits")
However for some reason at the first step the maximum token is different from the output of get_next_tokens(). Not sure if this is a bug or a misunderstanding.
import onnxruntime_genai as og
import numpy as np
prompt = '''<|user|>
Please tell me the time.<|end|>
<|assistant|>'''
model=og.Model("/home/ubuntu/models/Phi-3-mini-4k-instruct-onnx/cuda/cuda-fp16/")
tokenizer = og.Tokenizer(model)
tokens = tokenizer.encode(prompt)
params=og.GeneratorParams(model)
params.input_ids = tokens
generator = og.Generator(model, params)
i = 0
while not generator.is_done():
generator.compute_logits()
generator.generate_next_token()
new_token = generator.get_next_tokens()[0]
logits = generator.get_output("logits").squeeze()
new_token2 = np.argmax(logits)
print(new_token, " ", new_token2)
i += 1
if i > 10:
break
print()
And the result:
306   18
29915   29915
29885   29885
9368   9368
304   304
3867   3867
1855   1855
29899   29899
2230   2230
848   848
29892   29892

It is expected. The get_output(output_name) returns the output tensor with output_name. The prompt case returns the logits for the whole prompt with shape (batch, prompt_length, model_hidden_size)

Hi @anutkk
We added some more documentation for this API here: https://onnxruntime.ai/docs/genai/api/python.html#get-output
Please let us know if that helps you resolve your issue.

Thanks @natke and @yufenglee
If so how can I capture the logit of the first generated token? The matrix returned for the "prompt" (i.e. before calling compute_logits() I guess?) is zeroes.
I'm not entirely sure https://github.com/microsoft/onnxruntime-genai/pull/611 deals with this issue.

Thanks @natke and @yufenglee If so how can I capture the logit of the first generated token? The matrix returned for the "prompt" (i.e. before calling compute_logits() I guess?) is zeroes. I'm not entirely sure #611 deals with this issue.

@anutkk, to get the logits you can do like this:
    generator.compute_logits()
    logits = generator.get_output('logits')
    assert np.allclose(logits[:,:,::200], expected_sampled_logits_prompt, atol=1e-3)
    generator.generate_next_token()
```, like it is shown in the test file:
 https://github.com/microsoft/onnxruntime-genai/blob/c622cc11622dfb88b8b43f1e72347119b8728a25/test/python/test_onnxruntime_genai_api.py#L208-L211

@anutkk Let us know if that solves your issue!


License

This repository doesn't seem to have a license. Would it be possible for you to license this using an open source license?

@considerate I've added an MIT license.


twitter 401 Authorization Required error

I have seen a few tickets on this issue, but cannot seem to solve it using the solutions that were found at the time.  I have created my Twitter app and setup my keys in the .env file.  I have also made sure the callback url is setup according to the documentation, but I still get the 401 Auth error on the services page when I try to link it.  My server is running in AWS on ubuntu if that makes any difference.

Hi @jdragoo,
can you please post the complete exception include the backtrace and the obscured twitter oauth configution of your .env file?

This is the backtrace I see on the webpage after the failure.    (I forgot we still had the consumer key and secret here, you shouldn't need those, and I just removed them in #989.)

I get the error when making the service in the UI.  When I click the auth button under services it takes me to the error attached in the screen shot.  I tried it with the consumer keys as well just to make sure and of course still the same error.

Oh, I see.  What did you put as the callback URL when you registered with Twitter?  When I've had trouble in the past, this is often the problem.

http://huginn.jasonremote.com:3000/auth/twitter/callback

That looks correct, can you try to log out of your twitter account before you click on the "authenticate with twitter" button?

I tried that with no luck.  Do we think this is a problem with the Twitter app I created?  I have created a few and given them full access to everything and still have trouble.

I don't know, maybe try to delete your cookies? I remember having this issues once, and think I fixed it by signing out and back into huginn/twitter.

I agree about trying log in / out in both systems.
Also make sure you don't have any spaces or anything in the TWITTER_OAUTH_KEY or TWITTER_OAUTH_SECRET.

I've had this same problem for a while -- just tried wiping cookies, logging out, etc., without impact. I'm running on Heroku, and observed that the Huginn logs read as follows:
2015-08-28T01:51:13.941913+00:00 app[web.1]: [71bc5dc0-1609-47f3-9997-0fda9871bb3f] Started GET "/auth/twitter" for xx.xx.xx.xx at 2015-08-28 01:51:13 +0000
2015-08-28T01:51:14.045186+00:00 app[web.1]: [71bc5dc0-1609-47f3-9997-0fda9871bb3f]
2015-08-28T01:51:14.045193+00:00 app[web.1]: OAuth::Unauthorized (401 Authorization Required):
2015-08-28T01:51:14.045196+00:00 app[web.1]:   config/initializers/silence_worker_status_logger.rb:5:in `call_with_silence_worker_status'
2015-08-28T01:51:14.045198+00:00 app[web.1]:
2015-08-28T01:51:14.045199+00:00 app[web.1]:
2015-08-28T01:51:13.943801+00:00 app[web.1]: I, [2015-08-28T01:51:13.943650 #20]  INFO -- omniauth: (twitter) Request phase initiated.
At one point, I theorized that perhaps for some reason the Twitter Oauth tokens aren't being provided, even though they are configured?

I assume that other changes to your .env are being picked up?  Since you're on Heroku, are you using the .env, or are you using heroku config:set VARIABLE=value?

Yes, I had been setting via the Config variables. I had also tried putting them in as Credentials as well, but to no effect.
On August 28, 2015 8:13:59 AM PDT, Andrew Cantino<EMAIL_ADDRESS>wrote:

I assume that other changes to your .env are being picked up?  Since
you're on Heroku, are you using the .env, or are you using heroku config:set VARIABLE=value?

Reply to this email directly or view it on GitHub:
https://github.com/cantino/huginn/issues/988#issuecomment-135800815

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Do you have a .env file too?  They might be conflicting.

Nope, no .env file

I'm kind of at a loss.  Random thoughts:

Could there be extra quotes (") around the code in Heroku's settings?
Do other settings work?
Do other services work?

Good call, let me try other services and report back. That might help to isolate the issue.
Am I interpreting the logs correctly that it is failing to provide/read the right OAuth info?
On August 28, 2015 9:38:09 PM PDT, Andrew Cantino<EMAIL_ADDRESS>wrote:

I'm kind of at a loss.  Random thoughts:

Could there be extra quotes (") around the code in Heroku's
settings?
Do other settings work?
Do other services work?

Reply to this email directly or view it on GitHub:
https://github.com/cantino/huginn/issues/988#issuecomment-135940751

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

I'm not entirely sure.  Going to /auth/twitter should redirect you to Twitter's site for confirmation, then back to /auth/twitter/callback, which is the callback URL you should have given them.

So I have tried other services without a problem since that seems to be the next step.  The only one not working is Twitter.  I am in the process of setting it up from scratch on a test server to see if I get the same problem or if it works and could be related to the environment.

What callback URL did you give Twitter when you set it up?

I made sure to populate the App's callback on Twitter with the http://[NAME].herokuapp.com/auth/twitter/callback URL. I actually created two separate apps to test it (in case the first was flaky somehow), and neither seemed to make a difference.

http_s_://, right?

Apologies, yes, that is correct.

Here's what my app looks like.  Anything different?

Actually, never mind, that one is wrong.

That all seems right...  /auth/twitter/callback is what I use.  I wish we knew more about the error.  You could try running heroku run rails console and looking at ENV and making sure it looks right.

Vs. the App config above, mine was set as 'Read-Write' access and 'Sign-in' as 'Yes'. I changed both but that didn't seem to have any impact.
Just pulled the ENV and can confirm that shows all of the correct Twitter Oauth info.

That's very strange.  @dsander, @knu, anyone have any other ideas?

You probably need to track redirects using the browser's developer console.

I tried tracking redirects and I see a 500 Internal Server error when it calls http://site.com:3000/auth/twitter

You mean literally?  With no access_token parameter?

I'm not sure what you mean about the access_token parameter.  I just used firebug to follow where it was going when I clicked on the Auth with twitter button and it showed the final redirect back to my site in red with a 500 Internal Server error.

Oh wait, that's not the callback.  You aren't redirected to Twitter.com.  I have no idea at the moment, then.

In Chrome, in the Network tab of the Developer Tools, you checked the [ ] Preserve log checkbox, right?

It is checked.  Below is an attached screen shot with the red 500 error at the bottom that I get when clicking the Auth with Twitter button

Very odd.  Maybe it's not sending a param it needs?

I get more or less the same thing, which unfortunately doesn't really give any clues as to what the issue is.

It does seem like we have a Heroku bug.  Any chance you could give me access to your Heroku instance to poke around?  Email me at andrew [at] andrewcantino.com if you'd be open to that.

So I have installed Huginn from scratch on three different VM's both Ubuntu and Centos on and off AWS to see if there is anything I could find.  The final install always gives me this error when setting up the Twitter app.  The other services I configure seem to be running fine though.  Is it possible there is some prerequisite that we may be missing for Twitter to work?

Got your email-- I'll dig into it today or tomorrow.

See the email I just sent.
For everyone else: I figured out the issue-- @Ishfal had understandably gotten confused by the TWITTER_CONSUMER_KEY and TWITTER_CONSUMER_SECRET ENV variables that were in the .env.example file until I removed them in #989.  He had gotten the oauth application secret and token confused with these and had them switched.  Hopefully with their removal, this won't confuse anyone else.

Got it, thanks @cantino! So, for other users' benefit, the only info needed is what Twitter calls the 'Consumer Key (API Key' and the 'Consumer Secret (API Secret)', in the Apps interface (plus the right callback URL, etc.). Twitter's 'Access Token' and 'Access Token Secret' are not needed. Am I stating that correctly?
@jdragoo, does this solve your problem if you switch those?

Thanks @cantino, that was my problem as well.  I had the keys crossed.  Once I switched them it let me connect no problem.

Awesome, I'm glad it's working for both of you!  I'm going to close this issue.  Please open a new one if you run into anything else. :smile:

I am getting the same error and none of the above solutions work :(

I am getting the same error and none of the above solutions work :(

Same. This error is still occuring. I've been fighting this problem for a couple of days now. I started with the quickstart, that yielded the problem initially. I spent an entire day trying different things. This morning I came in and decided to follow https://github.com/huginn/huginn/blob/master/doc/manual/installation.md
and STILL no joy.  If I run in development, I see the error as a 401 (At one point I saw a 403, but it might have just been a callback URL I adjusted on the app page in Twitter to cause that), which is Unauthrorized. However, if I bring up the developer console in Chrome, I see that it's returning to http://huginn/services with a 500 Internal Server error. Even in production mode, and hitting http://huginn/auth/twitter seems to yield a 500 Internal Server error.
This either seems like a major regression or the bug was not really actually fixed.


Multiple episode download

Before asking:
Check through Issues and closed ones too if your question was already answered.
Question:
Is there a way to queue a download for an entire season, or can you only download one episode at a time manually?

Currently you only can download one media at a time.

Understood, thank you. Hopefully that will be added in the future.


[FEA] Add AzureML dependencies to docker images

Is your feature request related to a problem? Please describe.
Currently when using the RAPIDS docker images on AzureML there are errors due to mpi4py and azureml-sdk not being included which are requirements for AzureML.
Describe the solution you'd like
Add mpi4py via conda and azureml-sdk via pip (not currently on conda-forge) to the RAPIDS Docker images.
This adds ~650MB to the image size.
REPOSITORY                       TAG                                  IMAGE ID            CREATED             SIZE
rapidsai/rapidsai                cuda10.1-runtime-ubuntu16.04-py3.7   c870fd439a58        7 days ago          9.74GB
rapidsai/rapidsai                azureml-test                         f5261000ef69        13 seconds ago      10.4GB

Describe alternatives you've considered
Alternatively we could have an AzureML specific image which adds these libraries on top of the regular images. However this increases build complexity and number of Docker images.

@jacobtomlinson, is this something that could be solved with the env variables introduced in #170 (EXTRA_CONDA_PACKAGES & EXTRA_PIP_PACKAGES)? We currently omit PyTorch from our images due to its large size, so I'm not sure we'd want to add other large packages either. And also maintaining more variations isn't ideal either.

Ah yes those env vars may be a solution! Let me try.

It seems that AzureML overrides the default entrypoint with a custom one. So our preparation script is never called and we can't use the EXTRA_ options. I'm trying to see if I can override this option and set it back to our prepare script, but the config to get this working is getting a little unwieldy.

Ah awesome. That may be a good way forward then. Thanks @ajschmidt8


G400: ADC is not accurary

ADC look working, just 0.2V higher when reading, example, input 2.0V, reading show 2.2V.
This behavior did not happen in previous releases.

Nothing wrong in ADC driver. The board becomes bad. Accuracy values found on different boards.


Memory Error

@piergiaj thanks for the pyTorch implementation of i3d.
I'm trying to reproduce your results.
I'm facing memory error while running extract_features.py for rgb as well as flow part.
I'm able to generate few .npy files before encountering this error.
I'm using 1080 Ti 11 gb GPU and a machine having 16 gb ram.

Try reducing the 1600 frames to a smaller value, whatever will fit into your GPU's memory. I used 4 Titan X GPUs with 12GB memory for this script.
https://github.com/piergiaj/pytorch-i3d/blob/05783d11f9632b25fe3d50395a9c9bb51f848d6d/extract_features.py#L73-L79

Thanks a lot for the reply.
I already tried reducing the frame size to 100.
It still kept on running into memory errors.
Is there anything else that you think, can be done?

Thanks a lot for the reply.
I already tried reducing the frame size to 100.
It still kept on running into memory errors.
Is there anything else that you think, can be done?
Have you solved the problem? I have also encountered this problem

The models which you provided are not in parallel ??

You can write the code like the following because 'volatile' flag has been depriciated after pytorch 0.4.
with torch.no_grad():
for phase in ['train', 'val']:
i3d.train(False)  # Set model to evaluate mode
        tot_loss = 0.0
        tot_loc_loss = 0.0
        tot_cls_loss = 0.0

        # Iterate over data.
        for _, data in tqdm(enumerate(dataloaders[phase])):
            # get the inputs
            inputs, labels, name = data
            if os.path.exists(os.path.join(save_dir, name[0]+'.npy')):
                continue

            b,c,t,h,w = inputs.shape
            if t > 1024:
                features = []
                for start in range(1, t-56, 1024):
                    end = min(t-1, start+1024+56)
                    start = max(1, start-48)
                    ip = Variable(torch.from_numpy(inputs.numpy()[:,:,start:end]).cuda())
                    features.append(i3d.extract_features(ip).squeeze(0).permute(1,2,3,0).data.cpu().numpy())
                np.save(os.path.join(save_dir, name[0]), np.concatenate(features, axis=0))
            else:
                # wrap them in Variable
                inputs = Variable(inputs.cuda())
                features = i3d.extract_features(inputs)
                np.save(os.path.join(save_dir, name[0]), features.squeeze(0).permute(1,2,3,0).data.cpu().numpy())

I met the same problem. The error is: CUDA out of memory.
Maybe you can try to comment the following line:
i3d.cuda()
It worked for me.

May I know which GPU model you were using?

I met the same problem. The error is: CUDA out of memory.
Maybe you can try to comment the following line:
i3d.cuda()
It worked for me.

May I know which GPU model you were using?

I met the same problem，and I changed the one parameter of dataloader :pin_memory=False. if this parameter is false, the code would need smaller memory，but it requires more time.
And I think the frame size must be  a multiple of 8，because the temporal stride of I3D is 8。if it isn’t a multiple of 8, it maybe has wrongs when you stitch them together


Duplicate entries in history of combo boxes in search dialog

Describe the bug
Duplicate entries in history of combo boxes in search dialog
To Reproduce
Steps to reproduce the behavior:
open a combo, after a few search and restart
Expected behavior
there should be no duplicates
Desktop (please complete the following information):

OS: not relevant
Ripgrep Version not relevant

640daa2


Support EasyOCR

Add support for EasyOCR through the variable EASYOCR_MODULE_PATH.

Thank you!

Is it intended to not have 'json' extension?

Is it intended to not have a json extension?

Thank you, fixed with ad7ed1d.


Update metrics setup to match current Operator SDK practice

Since version 1.0.0 of the SDK, metrics are set up using kustomize and no longer with in-project code and the pkg/metrics package. We should follow suit: https://sdk.operatorframework.io/docs/building-operators/golang/migration/#export-metrics

@maayanf24 is this something you can look at?

@skitt is it still relevant?

No. It's done as part of operator-ask upgrade epic.

@skitt and I discussed this yesterday.


understanding deck.js demo (http://imakewebthings.github.com/deck.js/)

I discoveded deck.js some days ago and I was fascinated by it.
I read carefully deck.js html source (or, at least, I think so).
Unfortunately, I was not able to understand how the transition from one slide to another occours.
For example, how go from http://imakewebthings.github.com/deck.js/#slides-html slide to http://imakewebthings.github.com/deck.js/#slide-states slide?
The two successive slides are identified by two different ids in html source code (slide-html and slide-states) but I miss how text is placed or hidden (or colored!) to the screen according to them. I suppose that somewhere there is a (ordered) list of ids which defines transition between slides with the help of a css file, but I'm not sure...
Can you help me?
Thank you.

Hi @rinaldi6109,
It's important to understand the difference between deck.js itself, the "standard template" for your basic old-school slideshows (as seen on the Getting Started page), and my super customized project homepage.
As is stated on the front page, deck.js does little more than keep track of and apply a number of classes to elements. Beyond that, any styling, coloring, and transitions from slide to slide are all done in CSS.
The standard template seen on the introduction deck is the simplest way to use deck.js, defining slides as sibling elements within the deck container element.  If users choose to use this structure (and most do) then I've supplied three CSS files to choose from to style the appearance of slides, and three CSS files to define the slide-to-slide transitions.  You can take a look at those CSS files for a peak at how this CSS works.  They're located in the /themes/ directory.
As for my front page, the one you're asking about, I don't use any of the theme code used in standard decks.  It's a custom CSS file.  Most of the styles take advantage of the deck state classes. (deck.js maintains a class of the deck container that says something like .on-slide-1, .on-slide-2 , .on-slide-3, etc.)  I've tailored the styles and transitions for each step.  If you want to dig through that jungle the file is located in /css/home.css of the gh-pages branch.  Or you can just look at it here.
Feel free to continue asking questions here, but I'm going to close the issue as it isn't a bug.

As for my front page, the one you're asking about, I don't use any of the theme code used in standard decks.  It's a custom CSS file.  Most of the styles take advantage of the deck state classes. (deck.js maintains a class of the deck container that says something like .on-slide-1, .on-slide-2 , .on-slide-3, etc.)  I've tailored the styles and transitions for each step.  If you want to dig through that jungle the file is located in /css/home.css of the gh-pages branch.  Or you can just look at it here.

Thank you for the explanation. In the html file I see no "on-slide-n"
string, so I'm wondering if deck.js keeps track of the slide number.
In other terms: if I insert another slide, for example between slide 3
and 4, have I to change all the references to ".on-slide-4" which
should become slide 5?

Feel free to continue asking questions here, but I'm going to close the issue as it isn't a bug.

Thank you. I hope to have replied in the right place.

In other terms: if I insert another slide, for example between slide 3 and 4, have I to change all the references to ".on-slide-4" which should become slide 5?

Yes, this is how the core deck state works.  Luckily, the deck.hash module adds another deck state that uses the slide's ID.  So if you give all your slides id's, let's say:

title-slide
about-the-speaker
slides-overview
...etc

... you also get deck states of on-slide-title-slide, on-slide-about-the-speaker, on-slide-slides-overview, etc, so you don't have to worry about rearranging the order of your deck.  I just happened to write my front page before adding this feature and haven't had occasion to change it.

Yes, this is how the core deck state works.  Luckily, the deck.hash module adds another deck state that uses the slide's ID.

Wonderful. And thank you for your prompt reply.

I am looking for a presentation solution where I could explain large json structures and showing and highlighting pieces of json is a good way. Is there any alternative or better solution to achieve this or can deck.js be used to achieve this
@imakewebthings @rinaldi6109 @vaibhavbhuva


extended request options to support passing metadata match criteria

Signed-off-by: wbpcode<EMAIL_ADDRESS>Commit Message:
extended request options to support passing metadata match criteria
Additional Description:
Extended request options to support passing metadata match criteria. Check #15163 for more info about that why we need this PR. This PR is just a possible solution. I would be willing to modify it if there is a more elegant solution.
Risk Level: Low.
Testing: Added.
Docs Changes: N/A.
Release Notes: N/A.

/retest

@zuercher Thanks. 😄
I chose to pass MetadataMatchCriteria instead of envoy::config::core::v3::Metadata because of the following reasons:

In many cases, we can directly reuse the MetadataMatchCriteria from the route.

auto options =
  RequestOptions().setsetMetadataMatchCriteria(decoder_callbacks_->route()->routeEntry()->metadataMatchCriteria());

The MetadataMatchCriteria is generally fixed when we send http requests to external services via http calls in a filter. The MetadataMatchCriteria may change only when the configuration changes. Passing the MetadataMatchCriteria directly allows the developer to decide if the MetadataMatchCriteriaImpl object needs to be constructed, avoiding the need to reconstruct the MetadataMatchCriteriaImpl object each time a request is sent.

I discussed this briefly with another maintainer and the conclusion was that AsyncClient is one of the primary interfaces that a user of envoy as a library has to contend with. So I still think it would be better to limit this to using the proto types used to configure the feature for a route. Perhaps adding a method on the RouteEntry that allows access to the metadata_match proto objects would make it easier to implement your use case?

🤔 I agree with you, we can improve this part later.

Only one commit. I refactored it to create a cleaner implementation.

@alyssawilk can you take a second pass?

@alyssawilk did you mean @zuercher ?
Either way, I took a look; I don't think there's any public-facing change, so probably fine with no release note.


Add find_missing_groups function

Things left to do in this branch:

[ ] Add functionality to reduce the proposed set of groups to a minimal representation.
[ ] Add tests
[ ] Add docs
[ ] Maybe clean-up the way environmental smarts are handled? (For groups where we've combined multiple heavy atoms, only specify environments for the atom which is bonding to another group)

Codecov Report
Attention: 111 lines in your changes are missing coverage. Please review.

Comparison is base (de21d60) 59.59% compared to head (97459da) 41.50%.
Report is 7 commits behind head on main.

Files
Patch %
Lines

src/missing_groups.jl
0.00%
109 Missing :warning:

src/group_search.jl
66.66%
2 Missing :warning:

Additional details and impacted files
@@             Coverage Diff             @@
##             main       #5       +/-   ##
===========================================
- Coverage   59.59%   41.50%   -18.09%
===========================================
  Files           5        6        +1
  Lines         245      359      +114
===========================================
+ Hits          146      149        +3
- Misses         99      210      +111

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Auth token

How do I generate the auth token?

@rmaes4 You can use your database secret as an auth token.

I'm going to do some research on updating the current authentication method. https://firebase.google.com/docs/database/rest/auth

@gtchance Ok yeah I think that is deprecated now. Please let me know what you find out.

@rmaes4 1.6.0 now uses the Google OAuth2 access tokens. See here on how to create one.

Is there a way to do that using swift?

You can use this Objective-C library. Otherwise, you can just use the example code here to create a token then use it in your Swift code. If you find a way to do this all in Swift, let me know.

So I'm using Vapor which is a server side swift framework. I found this but I can't seem to wrap my head around how all of this oauth stuff works. I tried looking up the implementation in the Google java client library code but it seemed to be hidden.

https://stackoverflow.com/questions/46396224/how-do-i-generate-an-auth-token-using-jwt-for-google-firebase
Hoping I can get some help

@rmaes4 might be a Vapor python module like Perfect Python, than you can to run:
import google.auth.transport.requests
import requests
from google.oauth2 import service_account
from google.auth.transport.requests import AuthorizedSession

scopes = [
  "https://www.googleapis.com/auth/userinfo.email",
  "https://www.googleapis.com/auth/firebase.database"
]

credentials = service_account.Credentials.from_service_account_file("KEY FILE PATH", scopes=scopes)

request = google.auth.transport.requests.Request()
credentials.refresh(request)
access_token = credentials.token
print access_token

I dont understand why this is closed since it is not answered. i'm running into the same issue.
able to perform the requests with the deprecated way, but not able to create a token in swift with vapor.
any news?


docker why can't operate

I run 60 containers for some times, I found docker is dead, all docker commands can't used and they are always waiting and not show any information. And then I test the api operation, and also can't get anything.

@hanxy Please provide output of docker info, docker version and uname -a. All of this information is needed.
Please keep in mind that hardware problems, customized installs (custom kernel which isn't supported by the distribution), automated scheduled reboots and other external tools may interfere with Docker daemon's proper functioning.

@unclejack
My kernel is
"Linux kvmnode7553 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64    x86_64 x86_64 GNU/Linux"
docker info:
Containers: 65
Images: 25
Storage Driver: devicemapper
Pool Name: docker-252:2-8803-pool
Pool Blocksize: 65.54 kB
Data file: /dev/docker_vg/lvm_direct_data
Metadata file: /dev/docker_vg/lvm_direct_metadata
Data Space Used: 6.084 GB
Data Space Total: 2.199 TB
Metadata Space Used: 19.92 MB
Metadata Space Total: 5.369 GB
Library Version: 1.02.82-git (2013-10-04)
Execution Driver: native-0.2
Kernel Version: 3.13.0-24-generic
Operating System: Ubuntu 14.04 LTS
Debug mode (server): true
Debug mode (client): false
Fds: 376
Goroutines: 441
EventsListeners: 0
Init Path: /usr/bin/docker

Client version: 1.3.2
Client API version: 1.15
Go version (client): go1.3.3
Git commit (client): 39fa2fa
OS/Arch (client): linux/amd64
Server version: 1.3.2
Server API version: 1.15
Go version (server): go1.3.3
Git commit (server): 39fa2fa

Currently We start contariner and run the contaiber by remote API.
Unfortunately We run the containers for some days, and I can't do anything on docker.
include docker ps,docker info and others docker commands and found docker daemon api also can't access. So I am worry this problem.

@hanxy You need to install system updates and you also need to update Docker. Docker 1.3.2 is a rather old version and you should upgrade it to Docker 1.5.0. Kernel 3.13.0-24 is also very old and it should be updated to the latest kernel provided by Ubuntu on 14.04 (currently 3.13.0-46).

@unclejack ok, thanks, I will try it.

@hanxy Please let us know if this is still a problem. I've got Docker running 24/7 and I'm not seeing any such problems on Ubuntu 14.04. Please ensure your system is fully updated by using apt-get update && apt-get dist-upgrade -y and reboot. You also need to make sure you're running the latest Docker version.
There are known bugs in 1.3.2 and older versions which can lead to crashes of the Docker daemon.
I'm going to close this issue now because it has been reported against an old kernel which is known to be broken (3.13.0-24, latest was 3.13.0-48 last time I checked) and against an old Docker version.
If anyone can reproduce this problem with the latest kernel provided by the Ubuntu repositories and the latest Docker version, please comment.


Fixes and tests for C++20 Range compatibility

Addresses #240, as well as finding a problem with iterator_facade not being able to model random_access_iterator.
Define tests on each container that it satisfies the intended range concept. (This will transitively validate the iterators as well)

Fix: champ_iterator() was not default_initializable, which is a required for semiregular, which is required for iterators.
Fix: iterator_facade::operator[] returned a reference_proxy, while iterator_facade::operator* returns a ReferenceT. The random_access_iterator concept requires that the operators return an identical type.

Thank you so much for this contribution!


management: check x509 decoding errors

errors should not be ignored in this codebase, and https://github.com/kisielk/errcheck should probably be run over the whole repo.
this caused a hard to debug auth problem where i mishandled certificate decoding from azureProfile.json from the CLI.

LGTM, @jhendrixMSFT ?

Yep looks good, thanks for the fix.  :)


[HOLD for payment 2023-03-09] Profile page - More horizontal padding then other pages

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open app
Go to profile page

Expected Result:
Horizontal padding should be consistent with other pages
Actual Result:
Has more horizontal padding then other pages
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android / native
[x] Android / Chrome
[x] iOS / native
[x] iOS / Safari
[x] MacOS / Chrome / Safari
[x] MacOS / Desktop

Version Number: 1.2.63-0
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos:

Expensify/Expensify Issue URL:
Issue reported by: @shawnborton
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1675236178667749
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~01f8c06b3565752fb8
Upwork Job ID:<PHONE_NUMBER>905035776
Last Price Increase: 2023-02-02

on it today

@cristipaval, @kevinksullivan, @aimane-chnaif Whoops! This issue is 2 days overdue. Let's get this updated quick!

@cristipaval, @kevinksullivan, @aimane-chnaif Whoops! This issue is 2 days overdue. Let's get this updated quick!

not overdue.

@cristipaval, @kevinksullivan, @aimane-chnaif Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

Still in review

@cristipaval, @kevinksullivan, @aimane-chnaif Uh oh! This issue is overdue by 2 days. Don't forget to update your issues!

Reviewing label has been removed, please complete the "BugZero Checklist".

The solution for this issue has been :rocket: deployed to production :rocket: in version 1.2.77-4 and is now subject to a 7-day regression period :calendar:. Here is the list of pull requests that resolve this issue:

https://github.com/Expensify/App/pull/14855

If no regressions arise, payment will be issued on 2023-03-09. :confetti_ball:
After the hold period is over and BZ checklist items are completed, please complete any of the applicable payments for this issue, and check them off once done.

[ ] External issue reporter
[ ] Contributor that fixed the issue
[ ] Contributor+ that helped on the issue and/or PR

As a reminder, here are the bonuses/penalties that should be applied for any External issue:

Merged PR within 3 business days of assignment - 50% bonus
Merged PR more than 9 business days after assignment - 50% penalty

BugZero Checklist: The PR fixing this issue has been merged! The following checklist (instructions) will need to be completed before the issue can be closed:

[ ] [@aimane-chnaif / @cristipaval] The PR that introduced the bug has been identified. Link to the PR:
[ ] [@aimane-chnaif / @cristipaval] The offending PR has been commented on, pointing out the bug it caused and why, so the author and reviewers can learn from the mistake. Link to comment:
[ ] [@aimane-chnaif / @cristipaval] A discussion in #expensify-bugs has been started about whether any other steps should be taken (e.g. updating the PR review checklist) in order to catch this type of bug sooner. Link to discussion:
[ ] [@aimane-chnaif] Propose regression test steps to ensure the same bug will not reach production again.
[ ] [@kevinksullivan] Link the GH issue for creating/updating the regression test once above steps have been agreed upon:

@aimane-chnaif I think this regression test is pretty straightforward, right?

Open app
Go to profile page, observe padding between menu items
Go to preferences pages, observe padding between menu items
Confirm horizontal padding should be consistent with other pages

Going to go with this. Can you complete the remaining steps above so we can close this out @cristipaval @aimane-chnaif ?

Thanks everyone. Just an update on payment @aimane-chnaif . For whatever reason the original post says it's closed, and upwork isn't letting me recreate the job at the moment... I will have to check back on this Monday as I'm signing off shortly. Thanks for your patience!

not overdue. @kevinksullivan is taking care of this today.

on @kevinksullivan

Melvin, you ok? Just remove it, no need to instantly add it again.

Hahah, yeah, I think @kevinksullivan was swamped at the ECX last week and that's why he missed this one.

Hey @aimane-chnaif @cristipaval ! So sorry for the delay. Cristi is right - ECX was a lot, and then I got sick on my return and have been OOO, which slowed me down more 😅 ...
@aimane-chnaif I had to recreate the post and invited you to it. Can you let me know once you've accepted?
https://www.upwork.com/jobs/~019226bf24e884abee

Sorry @aimane-chnaif , withdrew one offer so there should be one now.

All set


Get error when run bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar grep input output 'dfs[a-z.]+'

After building the docker images,when I run the command in the container,got error:
Not a valid JAR: /usr/local/hadoop-2.7.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar  And how can I solve  this issue

jar path is /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar so that's probably your issue

cd $HADOOP_PREFIX
run the mapreduce
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar grep input output 'dfs[a-z.]+'


Calling assets from inside React components

Problem
Is there a way we can call static assets, like images for example, from inside React components?
I'm working on a store where we have a custom product builder experience built on React. On that UI we would still like to use a few static assets from the theme, but I'm not finding a way to load it.
Is declaring those images as global variables and pass them to React the only way to do it?

@lmartins you're going into unexplored territory with React + Liquid so I'm afraid there is not much I can say to help. But if passing it through a global works then I would start there?
Also, please keep in mind the Slate repo scope. This question is not really related to Slate.

@lmartins I did something just like this this week. Happy to help you out a bit if you need it.

You can email at<EMAIL_ADDRESS>

@t-kelly thank you for looking into this.
@isaac-martin I'll reach out via email, thank you for be willing to share your experience with this.


Add Back To Top button

Have you checked that your feature request isn't already filed?

[X] I read through FAQ and searched through the past issues, none of which addressed my feature request.
[X] Yes, I have checked that this feature request isn't already filed.

Description & Motivation
Add back to top button for post.
Some example:

https://jeffreytse.github.io/jekyll-theme-yat/

Pitch
when user browse the post content to any position except the top of the article, back_to_top button will appear in the lower left corner of the screen. If user touch the button, it will go back to the top of article.
Alternatives
No response
Additional context
I will contribute for this feature as possible as I can.

@george-gca Thanks for your time to review my commit code.
My PR has been merge into master #2427. I will close this issue.

@simonwei97 thanks for your contribution. Would you mind taking a look at the mobile version? The button is too close to the footer.

@simonwei97 thanks for your contribution. Would you mind taking a look at the mobile version? The button is too close to the footer.

OK. I will work on it. I was not considering to much for mobile device before.

[ ] mobile version optimization for back-to-top feature

@simonwei97 thanks for your contribution. Would you mind taking a look at the mobile version? The button is too close to the footer.

OK. I will work on it. I was not considering to much for mobile device before.

[x]  mobile version optimization for back-to-top feature

@george-gca hi, #2433 have some optimzation, will you review @abhilesh codes? Thanks.


Optimization of Fake Update strategy on Postgres

The subquery used to pick a random row in the Seed Table was slow since it required sorting the Seed Table for every row to update in the Target table.
This PR proposes an optimized method for picking a random row in the Seed Table.
The tradeoff is that it is pseudo random, not truly random.
The idea is:

add a sequential ID to the Seed Table
for every value to be updated, calculate its MD5
then convert it into an integer
take the absolute value in order to only have positive values
then use the modulo to cap this integer within the range of the Seed Table ids
then pick the row in the Seed Table with that ID

We achieved significant speed ups with this method, for instance a particular table that would take about 17 min to anonymize with the previous query only takes 16s now

also on this:

The tradeoff is that it is pseudo random, not truly random

I was thinking through the potential issues that this might cause.
The main change i can see is that multiple updates on the same table would be the same (because the id is calculated from the md5 of the row).
I think it's worth mentioning for due dilligence - I don't think that's a problem or a breaking change. people running multiple updates to a row is an edge case, most anonymization strategies i've seen contain one entry per table. I certainly wouldn't expect anyone to rely on that behaviour.

Isn't the MD5 calculated on individual columns ? I.e. if multiple updates are performed on a row but the different updated columns in that row contain different data, wouldn't that result in different fake data ?

Yeah, i guess so! Ha, so this is even less of a thing to worry about.
Looks great 🎉 I'll merge today and then look at releasing over the next week or so.

Update:
These changes are out in the wild in v1.25.0: https://pypi.org/project/pynonymizer/1.25.0/


nf-core module: entrezdirect/xtract

Write entrez-direct nf-core module: entrezdirect/xtract; ;  nf-core modules issue: new module: entrezdirect/esearch #1832.

Latest entrez-direct version: 16.2-0 Bioconda Package Index.

This module should work along with esearch and esummary to get the same results from the script generate_config.py implemented in the Snakemake pipeline.

PR merged: new (fixed) module: entrezdirect/xtract #1926.


"Knightship" map [Draft that's not marked because I hit the wrong button]

About the PR
Adds a new map for ultra-low-pop
TODO:

I need to check if this name is already occupied and if so figure out a new name

Screenshots

Changelog
:cl:

add: Adds a new map, "Knightship"

...I keep hitting the make PR button and I keep forgetting I can't convert them to drafts afterward AAAAAAAAAAAAAaaaaaaaaaaaa

Made some changes to ensure Kitchen can operate properly, voting for the map is setup, marking as ready for review

real speedmerge hours.

not sure how i feel about this, if this is merged we probably really need support for barring maps from the vote based on populations

...I keep hitting the make PR button and I keep forgetting I can't convert them to drafts afterward AAAAAAAAAAAAAaaaaaaaaaaaa

hidden af but its there

not sure how i feel about this, if this is merged we probably really need support for barring maps from the vote based on populations

yes, but i'd say we wanna add pop-dependent map-voting regardless

idunno about putting it into the defaultvotes tbh

I mean I get the feeling moony wants this merged solely to torture players, and if that's the case I'd rather just close the PR

I would still merge it just with it not being voteable. Until pop limits are in

I mean I get the feeling moony wants this merged solely to torture players, and if that's the case I'd rather just close the PR

Nah, looks like a really cool lowpop map.

@juliangiebel I've reverted the commit that makes it votable on the basis of two votes for not-votable

ideally i'd like for our tests to try loading all maps, not just saltern so we can make sure nothing is broken (#5403)


Fixed a leak in encodeQueryString

There was some incorrect bridging here causing a lot of leaks.
Added the proper bridging function for ARC CFBridgingRelease()

@willrust Have you had a chance to take a look at this?

@adomanico I no longer have write access to this repo. CC @swrainey

Closed since this repo seems to be dead.


feat(localization): Add Russian locale

Before submitting a pull request, please make sure you have at least performed the following:

[X] read and followed the CONTRIBUTING.md guide.
[X] linted, built and tested the changes locally.
[X] added/updated any applicable API documentation.
[X] added/updated any applicable demos.

Awesome, thank you for providing these!


New-vnet-integration - GA Date

Hi, I see the goal is to have the feature GA by mid-year of 2019. (This is a goal not a commitment.) 3 months ago. Just wanted to check if there is any change in the commitment.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a7a98803-1438-b1b5-f543-7dd88bc4294e
Version Independent ID: 37ff1d0f-ed8e-5e4d-1f4c-1b9f6cffb938
Content: Integrate app with Azure Virtual Network - Azure App Service
Content Source: articles/app-service/web-sites-integrate-with-vnet.md
Service: app-service
GitHub Login: @ccompy
Microsoft Alias: ccompy

@Syamala2604  Thanks for the question! We are investigating and will update you shortly.

@Syamala2604 Thanks again for the question! I have assigned the issue to the content author to get you update on this.

Hi, any updates on the estimated GA date for this capability?

Same here, any updates on the GA date yet?

Hi, this is something we are really waiting for. It would be really helpful to have some estimates about the GA delivery date, since it's a blocker for a few our projects.

Please see this comment above:
This feature is in preview but, it is supported for Windows app production workloads with the following limitations:

Same here, we are very looking forward to this feature as well.

@jcbrooks92 Any source that could prove this info ?

@arkiaconsulting
Based on this statement here "it is supported for Windows app production workloads"
This feature is in preview but, it is supported for Windows app production workloads with the following limitations:
You can only reach addresses that are in the RFC 1918 range. Those are addresses in the <IP_ADDRESS>/8, <IP_ADDRESS>/12, <IP_ADDRESS>/16 address blocks.
You cannot reach resources across global peering connections
You cannot set routes on the traffic coming from your app into your VNet
The feature is only available from newer App Service scale units that support PremiumV2 App Service plans.
The integration subnet can only be used by only one App Service plan
The feature cannot be used by Isolated plan apps that are in an App Service Environment
The feature requires an unused subnet that is a /27 with 32 addresses or larger in your Resource Manager VNet
The app and the VNet must be in the same region
You cannot delete a VNet with an integrated app. You must remove the integration first
You can have only one regional VNet Integration per App Service plan. Multiple apps in the same App Service plan can use the same VNet.

@Syamala2604 We will close this out but if you feel you need more information please just let us know.

When will it be supported for Linux workloads?


Fixing IAM Role/IAM User auditors for new cloudaux format.

Coverage remained the same at 51.915% when pulling 966cb2f497bdbfd7edfd6372f05f3bcce40f0465 on auditor_cloudaux_fixes into 18b96852776ec4d6c2c9b9bf95c6f7bf522ee462 on develop.


CamTwist no longer compatible with Zoom 4.6.9

Looks like one of the recent Zoom updates, 4.6.9, removes the entitlement that allows Zoom to load unvalidated libraries, preventing CamTwist from being recognized as a camera (the plugin is unsigned)
Using Zoom 4.6.8 I can still use CamTwist
https://objective-see.com/blog/blog_0x56.html

I'll do some testing on this tomorrow... Right now I'm running Zoom 4.6.9 and currently still have access to CamTwist. However, I a) haven't restarted too many services on my local system, and b) installed via Homebrew.
Thanks for the heads up, I'll update as things progress !

Hey @cleavenworth, so a couple of things: First, that was very interesting article. I knew Zoom was doing pretty stupid stuff (like using AES ECB for audio and video 🤦♂), but that privilege escalation stuff (and for a user-space shell script at that!) is crazy, especially in a notarized production app!
Now in relation to the reported issues, here are a few thing's I've observed:
I had upgraded from 4.6.8 to 4.6.9, and Zoom's entitlements are the same... It still has both com.apple.security.cs.disable-library-validation and com.apple.security.cs.disable-executable-page-protection set to true. So this would lead me to think that, in typical Zoom style, that while fresh installs might allow HR & SIP to their jobs, upgrades only upgrade features and not security? I'm not too sure... My logs seem to indicate that while the latest delta was install on April 4th, the code signing certificate has a timestamp of "Apr 2, 2020 at 4:06:02 AM" which would correspond with the release of 4.6.9, so either they lied, or they going out of their way to release separate new certificates where one is intentionally gimped.
When you run the following commands, what it the output?

codesign -dvvv /Applications/zoom.us.app/
codesign -d --entitlements :- /Applications/zoom.us.app/

Also, it might be worth running open ~/Library/Logs/zoominstall.log to check out the install log and see if anything fishy is going on there... I'll dig through the logs and see if there is any more information on the deltas it sends through and where they come from...

As of version 4.6.11 (20561.0413), entitlements are removed during the update process.

So this is issue if definitely confirmed... I'm try to see what other options might be our there to resolve/work around this.
In the meantime, for anyone needing to track down version 4.6.8, at the time of writing it available here; so make sure you save a copy if you download it and think you may need it at some pointin the future: https://us04web.zoom.us/client/4.6.19178.0323/Zoom.pkg

See this comment for a (rather poor) workaround... This requires an Apple Developer account, and while not ideal, it is a step in the right direction: https://github.com/johnboiles/obs-mac-virtualcam/issues/4#issuecomment-612168361

I just ran
sudo codesign -f -s - /Applications/zoom.us.app

I don't know if that requires a dev account or not (I do have one), but was only prompted regular sudo pw and that option worked

Hey @hessius; I just confirmed this on a system without a developer comment... Thank you! I'll update the documentation with these comments 😄


Deno is panicking with programming error: cannot use matches with a tag:

I posted this here rather than the main repo after seeing indicators in the backtrace that it was happening in the deno_semver crate.

I'm running into a persistent panic with the LSP and CLI in a monorepo project. This is causing the language server to be completely unusable, as it just repeatedly crashes and ultimately gives up altogether.
The error message is very cryptic and uninformative, however, and doesn't specify which package or file this is occuring in. All it states is programming error: cannot use matches with a tag:.
This all started after I moved a directory in VSCode, so I'm thinking it broke some imports somewhere along the way. Unfortunately this is in a project with several thousand files so I have my work cut out for me trying to track it down... I'm spending my afternoon checking file by file trying to track down a specifier syntax issue that might be causing it.
Any suggestions are very much appreciated. Thanks.
Oh, here's the backtrace:
============================================================
Deno has panicked. This is a bug in Deno. Please report this
at https://github.com/denoland/deno/issues/new.
If you can reliably reproduce this panic, include the
reproduction steps and re-run with the RUST_BACKTRACE=1 env
var set and include the backtrace in your report.

Platform: linux x86_64
Version: 2.0.0-rc.2+315baeb
Args: ["/usr/local/bin/deno", "lsp"]

thread 'main' panicked at /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/deno_semver-0.5.13/src/lib.rs:284:32:
programming error: cannot use matches with a tag:
stack backtrace:
   0:     0x5fb919aaa6d5 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hd736fd5964392270
   1:     0x5fb919add0bb - core::fmt::write::hc6043626647b98ea
   2:     0x5fb919aa471f - std::io::Write::write_fmt::h0d24b3e0473045db
   3:     0x5fb919aaa4ae - std::sys_common::backtrace::print::h45eb8174d25a1e76
   4:     0x5fb919aabf19 - std::panicking::default_hook::{{closure}}::haf3f0170eb4f3b53
   5:     0x5fb919aabcba - std::panicking::default_hook::hb5d3b27aa9f6dcda
   6:     0x5fb91a0dab56 - deno::setup_panic_hook::{{closure}}::h3237b3de083c825a
   7:     0x5fb919aac58b - std::panicking::rust_panic_with_hook::h6b49d59f86ee588c
   8:     0x5fb919aac304 - std::panicking::begin_panic_handler::{{closure}}::hd4c2f7ed79b82b70
   9:     0x5fb919aaab99 - std::sys_common::backtrace::__rust_end_short_backtrace::h2946d6d32d7ea1ad
  10:     0x5fb919aac037 - rust_begin_unwind
  11:     0x5fb919ad9fd3 - core::panicking::panic_fmt::ha02418e5cd774672
  12:     0x5fb91be11747 - deno_semver::VersionReq::matches::h5f21d86ad500b707
  13:     0x5fb91bd646d6 - deno_config::workspace::resolver::WorkspaceResolver::maybe_resolve_specifier_to_workspace_jsr_pkg::ha96f3f7315503564
  14:     0x5fb91bd63e80 - deno_config::workspace::resolver::WorkspaceResolver::resolve::h359ed27c63364e90
  15:     0x5fb919fd1dc3 - <deno::resolver::CliGraphResolver as deno_graph::source::Resolver>::resolve::h6be29659591a893d
  16:     0x5fb91b8f224a - deno_graph::graph::resolve::h2a06e986c6faf615
  17:     0x5fb91b8f5dbb - deno_graph::graph::fill_module_dependencies::h0d2f6d5d0f0f4e16
  18:     0x5fb91b8f4dd4 - deno_graph::graph::parse_js_module_from_module_info::he3483b46ba6d4a9e
  19:     0x5fb91b92b314 - deno_graph::parse_module_from_ast::hd4153ab837458cf0
  20:     0x5fb919f1063e - deno::lsp::documents::analyze_module::ha78dd9083200ff8a
  21:     0x5fb919f104a8 - deno::lsp::documents::parse_and_analyze_module::h45ca056ad65b73b6
  22:     0x5fb919f0cb83 - deno::lsp::documents::Document::new::h5e0afae00d343d80
  23:     0x5fb919f0e9e5 - deno::lsp::documents::FileSystemDocuments::refresh_document::hfea0c3a91c658922
  24:     0x5fb919f2ab8b - deno::lsp::language_server::Inner::refresh_documents_config::{{closure}}::h55949ef63a5d6bc5
  25:     0x5fb919f67de9 - deno::lsp::language_server::Inner::initialized::{{closure}}::he344b926a6bb07ee
  26:     0x5fb91a0f2393 - <deno::lsp::language_server::LanguageServer as deno_tower_lsp::LanguageServer>::initialized::{{closure}}::ha1b0a82ccf9f5b37
  27:     0x5fb919b5f8f0 - deno_tower_lsp::jsonrpc::router::Router<S,E>::method::{{closure}}::{{closure}}::{{closure}}::h292e7e391d2eb019
  28:     0x5fb919e40b17 - <futures_util::future::future::Map<Fut,F> as core::future::future::Future>::poll::hb18bc7be64799f41
  29:     0x5fb919d74f42 - <core::pin::Pin<P> as core::future::future::Future>::poll::hfc854d0000d7fd15
  30:     0x5fb919d74f42 - <core::pin::Pin<P> as core::future::future::Future>::poll::hfc854d0000d7fd15
  31:     0x5fb919b5123c - <deno_tower_lsp::service::LspService<S> as tower_service::Service<deno_tower_lsp::jsonrpc::request::Request>>::call::{{closure}}::h62f06b5582d41ad3
  32:     0x5fb919b7a496 - deno_tower_lsp::transport::Server<I,O,L>::serve::{{closure}}::hc05f4f00e9f950a4
  33:     0x5fb91a0d410c - deno::spawn_subcommand::{{closure}}::hefc8970e6a77d0c2
  34:     0x5fb919af929b - <deno_unsync::tokio::task::MaskFutureAsSend<F> as core::future::future::Future>::poll::hb65a54ec1ff3e7ad
  35:     0x5fb919d27d65 - tokio::runtime::task::raw::poll::hb6276fdedbe3257e
  36:     0x5fb91a0dc78d - deno::main::he16584fcc5954e46
  37:     0x5fb919be5d4c - std::sys_common::backtrace::__rust_begin_short_backtrace::h0e5f3c6e54197981
  38:     0x5fb919bf235d - std::rt::lang_start::{{closure}}::hf297db38d0dfe9fe
  39:     0x5fb919a9869d - std::rt::lang_start_internal::hcee5ed89fc25829a
  40:     0x5fb91a172b55 - main
  41:     0x75c224237d7a - __libc_start_main
  42:     0x5fb918439029 - _start
  43:                0x0 - <unknown>
[Error - 9:17:15 PM] The Deno Language Server server crashed 5 times in the last 3 minutes. The server will not be restarted. See the output for more information.

@dsherret this seems related to what you mentioned in draft #25

@nberlette do you have a reproduction?

@dsherret yeah I think I can throw something together for you here shortly. I actually just tracked down the culprit that was causing the LSP to crash on me. It came down to a single file with a missing version in an import.
When I corrected this:
export * from "jsr:@type/is@"; // <- no version

Into this:
export * from "jsr<EMAIL_ADDRESS>
Everything immediately started working again (following a server restart obviously).
FYI here's the output of Deno.version:
{
  deno: "2.0.0-rc.6+88a4f8d",
  v8: "<IP_ADDRESS>-rusty",
  typescript: "5.6.2"
}


[BUG] Distant computer (4 GPUs 10GiB of VRAM each) crashes the second i launch the finetuning using AutoTrain localy

Prerequisites

[X] I have read the documentation.
[X] I have checked other issues for similar problems.

Backend
Local
Interface Used
CLI
CLI Command
autotrain --config config.yml
UI Screenshots & Parameters
This is my CLI when the distant computer crashes :

This is my Config.yml file  :

Error Logs
This is the error in BitVise when the computer crashes

Additional Information
Hello Everyone, im a newbie to AutoTrain, im trying to finetune a 7B mistral param using AutoTrain localy (since i got 4 gpus with 10 GiB of Vram each) in a distant computer for which im using BitVise to connect via SSh. i was using the SFT Trainer of Huggingface and faced many issues related to CUDA memory for that reason i decided to move to Autotrain since its easier.
N.B : I have done everything i know to optimize (LoRa, 4bit model loading, lower batch size, etc...) i also tried the DDP before (Distributed data paralel).
I have found some memory usage estimation of fine tuning this same model in BF16 precision that says the peak of Adam is 56gb of Vram which i dont have for the moment. Do you think renting some GPUs from RunPod or Huggingface would fix the issue for me ?
Thank you for your guidance.

are you running the autotrain --config command on the same computer or a remote pc?

maybe your gpus are not supported. which gpu do you have?
can you try with quantization: null?

I will try using quantization: null soon, although I doubt it will fix the error. Based on my experience, the minimum effective level of quantization is 4-bit. Setting it to null will not quantize the model at all.

if you cant run nvidia-smi, then thats the possible cause. you will need to restart the remote machine :)

No, you didnt get it. its not about i can not run the nvidia-smi. the whole ssh conneciton is broken but once i restart it everything works just fine i can run whatever i wish (including nvidia-smi). But the problem is the second i launch the finetunine with the autotrain -- config config.yml the machine crashes

Can you tell me whether my gpus are supported ? Maybe they are insufficient right ?


[incubator/jaeger] Fixed jaeger chart config options

What this PR does / why we need it:
Fixes the Configuration options for the Jaeger chart.
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #
Special notes for your reviewer:

/assign @seanknox

cc @dvonthenen @mikelorant @pavelnikolov

/assign

/lgtm

/assign @seanknox

/ok-to-test

Just updated the chart version, @unguiculus can you please review again.

| /test pull-charts-e2e
-- | --

/retest

/lgtm


Adds the git show alias gsh

First time contributing. Let me know if you find any issue with it and I'll be glad so solve.
Also, thank you very much for oh-my-zsh. It's a great tool to our productivity. 🤘

@ncanceill

@ncanceill that PR will complete three months on pending review/merge. Is there anything wrong with it? If there isn't, is there anything I could do to have it merged?
Thank you in advance for your time.

Hi, happy New Year, sorry for taking so long.
A quick Google search turned up only two gsh commands, neither of them seeming widely used, and there is no gsh alias in the OMZ codebase.
So this looks fine to me. 👍

Yay! Awesome! 🍻

One year watching a pull request! 🎉

Still waiting - recently installed zsh, and was about to make a PR of my own, :+1:!

@jeffvandyke yeah, I'm waiting too. No feedback at-all. But have faith, and join me in my party for two years of PR. Happening soon!


*: upgrade rustc and clippy

To upgrade rustc, use following command:
rustup override set nightly-2017-05-29

LGTM
CI failed but it may be caused invalid RocksDB version, I think we can upgrade RocksDB to 5.4.5 at first.

LGTM

Maybe we should use another cache for CI


Build for Windows?

I see that this library builds Node addons only on Linux and only for Linux.
It possible to create builds for Windows?

I'm not familiar with Windows system. You can make a PR if you want


Add default issue template

In order to try to improve the quality of issues and prevent issues being raised against the wrong repository

Why has this created a merge request?


[CLN] Cleanup query node after pushdown

Description of changes
Summarize the changes made by this PR.

Improvements & Bug fixes

Remove unused impls in query node after query pushdown landed

New functionality

N/A

Test plan
How are these changes tested?

[x] Tests pass locally with pytest for python, yarn test for js, cargo test for rust

Documentation Changes
Are all docstrings for user-facing APIs updated if required? Do we need to make documentation changes in the docs repository?
N/A

I've reaped the dead codes that are unlikely to be used. The remaining ones are used by unit tests right now, so I'm planning to keep them for now.

Merge activity

Dec 11, 3:21 PM EST: A user started a stack merge that includes this pull request via Graphite.


Add support for android bundles on cloud

Right now when trying to upload a bundle file (.aab) it say that the type it's not supported. Can you add support for it?

You can extract .apk from .aab using bundletool from Android SDK.
See also this SO question.


CAMEL-13601 - Fix camel-jira client close and add logging

https://issues.apache.org/jira/browse/CAMEL-13601

Done, thanks for the review.

What's the reason for Guava version downgrade?

Merged on master

Thanks


SetBackButtonTextProperty doesn't work

Hi,
I have been experiencing this issue when I use FreshMvvm. I tried to make this official steps: https://montemagno.com/changing-ioss-back-button-text-in-xamarinforms/
But it doesn't when I put a page in front with: await CoreMethods.PushPageModel<T>();
I tried this without using FreshMvvm and it's working.
Thanks in advantage.

https://newbedev.com/how-to-change-the-back-button-text-on-xamarin-forms
After apply this, it's working.


setsockopt fails to set IP_MTU_DISCOVER in SOCK_SEQPACKET

Problem:
Set up a QUIC client that dials to a server via a Unix Sequenced Packet socket (SOCK_SEQPACKET)
That triggers this error: https://github.com/lucas-clemente/quic-go/blob/master/sys_conn_df_linux.go#L32
setting DF failed for both IPv4 and IPv6
Reproduce:
Run this command to set up a SOCK_SEQPACKET: socat -v UNIX-LISTEN:/tmp/uds,socktype=5 -
Then run this main:
package main

import (
	"crypto/tls"
	"net"

	"github.com/lucas-clemente/quic-go"
)

func main() {
	remoteAddr := &net.UnixAddr{
		Net:  "unixpacket",
		Name: "/tmp/uds",
	}
	conn, err := net.DialUnix("unixpacket", nil, remoteAddr)
	if err != nil {
		panic(err)
	}

	tlsClientConfig := &tls.Config{
		InsecureSkipVerify: true,
		NextProtos:         []string{"h3"},
	}
	quicConfig := &quic.Config{}
	_, err = quic.DialEarly(conn, conn.LocalAddr(), "example.com", tlsClientConfig, quicConfig)
	if err != nil {
		panic(err)
	}
}

That will fail with the above mentioned error.
This used to work in v0.24 but stopped working ever since: https://github.com/lucas-clemente/quic-go/pull/3328/files#diff-446dcd03f343ca7249e090d11da194b71c2524d2c2ed49540c9e2085c1236291
Should we not fail hard in that case?

Any idea why setting DF fails in this case? I'm not familiar with SEQPACKET.

Any idea why setting DF fails in this case? I'm not familiar with SEQPACKET.

Because it's a unix domain socket for local IPC. The concept of fragmentation doesn't apply here.
Perhaps we should check whether conn is a real network connection, or simply ignore the error?

Perhaps we should check whether conn is a real network connection

That sounds like a good solution. The connection returned by DialUnix returns a net.UnixAddr on LocalAddr. We could run the DF code iff LocalAddr returns a net.UDPAddr.
Does that sound reasonable? Want to submit a patch, @nmldiegues?

Want to submit a patch, @nmldiegues?

Will do.


[BUG]: ESign on orders not working

Describe the bug
ESign on orders not working
To Reproduce
https://github.com/user-attachments/assets/a7788b63-dad3-40df-992f-3dc9475c8ca5

Hi @rajeshcherukumalli Please recheck the issue.

Its working fine in UAT env.

https://jam.dev/c/e6b43324-aa75-4009-afa5-8fd72d46d5c4

Closing ticket as it is not reproducible


refactor: refactor tools, streamline amending doc for tools, refactor type_o_tooluse to ToolUse.from_type

TODO

this code has issues, fix them

:x: 16 Tests Failed:

Tests completed
Failed
Passed
Skipped

17
16
1
0

View the top 3 failed tests by shortest run time

 tests.test_browser

Stack Traces | 0s run time

No failure message available

 tests.test_eval

Stack Traces | 0s run time

No failure message available

 tests.test_tools_python

Stack Traces | 0s run time

No failure message available

To view individual test run time comparison to the main branch, go to the Test Analytics Dashboard


inclusion into F-Droid?

Would you have any problem with me sumitting this app into the F-Droid repo of free software android apps?

This is not a functional app. If F-Droid is a repository like this(github) I have no problem of you submiting the code. If F-Droid is an app market, I think this app on its own is not useful, as is literally for controling my living room. On the other hand if you modify the code of the app and make it functional as a more generic standalone app I have no problem if you submit that. A mention in the credits would be awesome but it is not required.


Properly cache hilbert curves

Hilbert curves need to be properly cached. I think this should be done once right when the packet initializer is created. It might take a bit of startup time. It could also be done at compile time. That's possible, but it might create insane compile time We will see. This includes the "area" caches too
https://github.com/andrewgazelka/hyperion/blob/feat-broadcast/broadcast/src/lib.rs#L24-L49

moving away from hilbert from now... for areas they are kinda complicated


Integration with iscroll

A fixed toolbar (stay on top) with scrollable content gives a true native application feel.
iScroll is the best implementation available. One of the solution is to integrate with iScroll.
http://dev.beedesk.com/jqtouch_iscroll/jqtouch-1.0-r149/demos/iscroll/

Known issue with the above integration:

some interference with page transition. On desktop, if you navigate to another page, scroll still follow the mouse even if mouse button is released.
Similarly, it needs some work to get swipe working.

Sorry, no iScroll integration out of the box. Next release will include the iOS5 native scrolling.


OrgSiteMember&OrgSiteMembers now children of abstracts TerminusModel & TerminusCollection

Part of #411

Once again, difficult for me to offer deep insights, looks like the correct application of the pattern though. +1 :)


top by device-type

This is a counter that will group hits by device type.
And, at least we have 3 access types:
1: desktop
2: mobile devices
3: other (eg: crawlers)
Very useful on analytics to apply some strategy.
desktop: X hits ( x%)
mobile: Y hits (y%)
other: Z hits (z%)

@allinurl I think perhaps it would be a good idea to consider reopening this issue?
We would love to have device type information in the JSON output, or alternatively pure UA strings grouped somehow perhaps? I.e. It would be nice to have Windows NT 6.3; ARM (Or those with touch identifiers perhaps?) type devices not just classified as windows, but rather surface devices and so forth imo?

Just a thought for the longer term - can we strive to provide a comprehensive / near complete device coverage? - if we'd have a conscience lexical parallel of Device:to:Browser even with manufactor specific / vendor specific pollutants :smile: (ms, vs). I'd approximate that a database with ~10k-18k of known devices out there would be a 97%+ coverage of all thats mobile & maybe in circulation from NetFront, HTML4, Java, MMS, SymbianOS, WAP, WEB, WHL, Windows, WindowsCE, etc...
Using a few known listings & articles (0, 1, 2, 3, 4) as guide the following lexicon may be a good start:

UA keyword
device
full UA sample string of a specific device

UP. / up.b / up/
Openwave Mobile Browser / telephone
AUDIOVOX-CDM-8915 UP.Browser/<IP_ADDRESS>.h.1.102 (GUI) MMP/2.0

BlackBerry, BlackBerry, UP., up.b, up/ vs
BlackBerry device / telephone
BlackBerry6510/4.0.0 UP.Browser/<IP_ADDRESS>

HP, hp-tablet or msvs
HP device / telephone
HTC_Touch_HD_T8282 Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 7.11)

HP, hp-tablet or msvs
HP device / telephone
Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC; 240x320)

HTC, HTC_, HTC- or msvs
HTC device / telephone
HTC_Touch_HD_T8282 Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 7.11)

HTC, HTC_, HTC- or msvs
HTC device / telephone
HTC_S310-Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; Smartphone; 176x220)

LGE, LG-, lg-, LG/
LGE tablet / telephone
LG-T300/V100 Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/C

LGE, LG-, lg-, LG/
LGE tablet / telephone
Mozilla/5.0 (Linux; Android 4.1.2; LG-P760 Build/JZO54K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1700.99 Mobile Safari/537.36

SAMSUMNG, samsung, sam-, sam or msvs
Samsung tablet / telephone
SAMSUNG-SGH-A737/UCGI3 SHP/VPP/R5 NetFront/3.4 SMM-MMS/1.2.0 profile/MIDP-2.0 configuration/CLDC-1.1 UP.Link/<IP_ADDRESS>.0

SAMSUMNG, samsung, sam-, sam or msvs
Samsung tablet / telephone
samr810 Netfront/3.4 Mozilla/5.0 like Gecko/20060426

sie-, SIE-
Siemens telephone
 SIE-SK6R/46 UP.Browser/<IP_ADDRESS>.d.1.100(GUI) MMP/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

SonyEricsson, sonyericsson, Sony Tablet, or msvs
SonyEricsson  tablet / telephone
SonyEricssonK608i/R2BA Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1

SonyEricsson, sonyericsson, Sony Tablet, or msvs
SonyEricsson  tablet / telephone
 SonyEricssonK608i/R301 Profile/MIDP-1.0 Configuration/CLDC-1.0

A complete device focused list of manufacturers & relevant providers in the global context could comprises of approximately ~ 142 with more UA's by distributor / OEM ? :

A-Z of makes & vendors

Acer, Airness, Alcatel, Allview, Amazon, Amoi, Apple, Asus, AT&T, Audiovox

BlackBerry / RIM , Benefon, Benq, Benq-siemens, Bird, BLU, Bosch

Casio, Cat, Celkon, Chea, Coolpad, Cricket, Dell, DoCoMo (NTT Mobile)

EE, Elson, Emporia, Emblaze, Energizer, Ericsson, Eten, Ezio, Ezze

Fly, Foxconn, Fujitsu Siemens, G3, Garmin-asus, Gigabyte, Gionee

Haier, HP, HTC, Huawei, Jolla

I-mate, I-mobile, Icemobile, Innostream, iNQ, Intex

Konka, Kyocera, Karbonn, Lava, Lenovo, LGE

Maxon, Maxwest, Meizu, Micromax, Microsoft, Mitac, Mitsubishi, Mobilexp, Mobistel, Modelabs, Modu, MWg, Motorola, My Way

Nec, Neonode, Nintendo, NIU, Nokia, nook, Nvidia, O2, Obigo, Onda, Orange, OnePlus, Oppo

Palm, Panasonic, Pantech, Parla, Philips, Phoneone, Psion, Plum, Posh, Prestigio, QMobile, Qtek

Sagem, Samart, Samsung, Sanyo, Sec, Sendo, Sewon, Sharp, Siemens, Skyspring, Sonim, Sonim, Sony, Sony Ericsson, Spice, Sprint, SPV

T-mobile, Tel.Me., Techfaith, Thuraya, Toshiba

UCWEB, Uniscope, Uriver, Utec, Utstarcom, Vertu, verykool, Virgin, Vitelcom, Vivo, Vk Mobile, Vodafone, Voxtel

Wellcom, Wiko, WND, XCute, Xiaomi, XOLO, Yezz, Yota, YU, ZTE

This list excludes all potential UA such as those by service, application, proxy, etc, from the 1.5+ million (& growing) already classified in some directories with others yet to emerge for vehicle / automotive (your car) and television (not sure how unique these are) systems.
I can help in the compilation of the proposed DB.

@overnine assuming we still want to use the ones posted above, i.e., desktop, mobile, others then I think we could add this as a new panel. Categorizing this could be tricky. Are those the only categories we could use? Should we have tablets as well?
@aphorise having a comprehensive list of browsers and OSs would be awesome, but we may need to refactor browsers.c & opesys.c since currently those are bottlenecks. (the size of the list is proportional to the run time, which makes them slow). We could have a large list mapped in a hash but it would need to be a full match search. Or bsearch perhaps?
For the record, this may be related to #152.

@allinurl i only use goaccess for the json output, i dont really have any considerations in terms of usability of the curse interface. Also the most comprehensive resource i know of which handles this is https://github.com/serbanghita/Mobile-Detect

@allinurl - I actually think we can do this adaptively / build on a global browser & device context. So instead of having fixed size table / bsearch or hash - have a tree that spans / adaptively increases based on new / differing UA's that read and that would only get a naive  comparison against a master UA-DB  / record once.
So basically the the UA-DB (lexicon) can have two focuses:

by device (as per earlier comment & proposal) - that'd be a potential look up of 1 in ~ 18``k (estimate).
by service or anything else (as per known & remaining lot in excess of a million)  - that'd be a potential look up of 1 in ~ 1.4``m (estimate).

The ideal UA lexicon that would be ( adaptive-UA) adaptively built from the data-set (logs) being parsed and could be an O(n) algorithm if its stored in ahash or a O(n^2) if its in some other from (btree, link-list); either-way the scope of any set in most cases should be less than < complete-UA O(n) or O(n^2)thats the total space / list of everything thats known & can be targeted.
What'd be even smarted for real-time stats & scenarios where adaptive-UA can / may grow indefinably would be to have a stack-limit to a reasonable size 2^32 or 65535 - thereby dropping any single / one time occurrences; all that would be needed is a FIFO / FILO (first-in-first-out / first-in-last-out) precedence on the lower portion (say a reserve of 255)  so as to always accommodate and record new / single 1 time agents that would always register and would be visible in the most recent time-frames. Ditto governing rules for what can move up the adaptive-UA
I hope I'm  clearing conveying the intent.

For reference the RAM / memory space requirements to hold all potential UA can be expressed as:

#
for 65535 records

MAX  / unlikely case

(2^16)-1=65,535
bytes per record max

65535^2=4,294,836,225
bytes (~``4``Gbytes)

AVG q3 / possible upper-quartile

(2^11)-1=2,047
bytes per record avg-q3

2,047*65535=134,150,145
bytes (~``134``Mbytes)

AVG q1 / possible lower-quartile

(2^9)-1=511
bytes per record avg-q1

511*65535=33,553,920
bytes (~33``Mbytes)

AVG / common sub-or-at-average

(2^8)-1=255
bytes per record real average

255*65535=16,711,425
bytes (~``16``Mbytes)

This is on the assumption that no UA are alike (all unique for 2^16-1) and that none shall ever exceed 64``Kbytes which is unreasonably high & frankly even graver than stupid if neared or exceed. The most obvious candidates of illogical uses which tend to exceed the common 512-1024 (bytes) are for example *Internet-E*xplorer (IE) or other debug or build specific text that may be embedded as part of the UA identifier - even these tend to be < 8``Kbytes at worse.
A few other rules can also be applied as objectively determinates anything that may not match but may for example be found in one of a few known criteria scope of device &/or browser :

DEVICE: 1 of 143 manufacturer-UA
BROWSER:1 of < ~ 64 application-UA chrome/blink et al, firedox et al, geko, trident / IE / MOSIAC, Netscape, Opera, Safari, Webkit, etc.


VERPAT has DESCRIPTION and NAMESPACE file but is not meant to be a package and fails if you try

Suggest these get deleted since their presence enables the 'build' options in RSTUDIO and they fail because run_model.R is not in the expected directory 'R'

I merged the change with a comment that we should discuss whether VERPAT should be a package or not. I think you're right, it should not be a package. If it was a package, that would complicate the process for the user to add model input files or change parameter files, so I think that it shouldn't become a package.

I was just following your lead on VERSPM which I figured represented your current thinking. Plus VERPAT documentation could not be build because collate of run_model.R failed (maybe because it was not in an ‘R’ subdirectory?)
……………………………………………..
PETER ANDREWS
Senior Software Engineer
RSG
55 Railroad Row | White River Junction, VT 05001
o<PHONE_NUMBER> | m<PHONE_NUMBER>
www.rsginc.comhttp://www.rsginc.com/
……………………………………………..
From: gregorbj<EMAIL_ADDRESS>Sent: Tuesday, March 28, 2017 2:25 PM
To: gregorbj/VisionEval<EMAIL_ADDRESS>Cc: Peter Andrews<EMAIL_ADDRESS>State change<EMAIL_ADDRESS>Subject: Re: [gregorbj/VisionEval] VERPAT has DESCRIPTION and NAMESPACE file but is not meant to be a package and fails if you try (#70)
I merged the change with a comment that we should discuss whether VERPAT should be a package or not. I think you're right, it should not be a package. If it was a package, that would complicate the process for the user to add model input files or change parameter files, so I think that it shouldn't become a package.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHubhttps://github.com/gregorbj/VisionEval/issues/70#issuecomment-289860639, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AA2RkVSgHXQMcKf4Dh95oUECK7wTfK14ks5rqVBngaJpZM4Mr3Dh.

The current approach makes sense to me. The structure is simple and easy to understand. If it was an R package, the structure would be more complicated. I don't see an advantage of changing the structure, but I want to make sure I'm not missing something.


RecordingStorageMode info missing

I would appreciate to know which are the available values for RecordingStorageMode in addition to Stream.
Is it possible to store the data directly to the client hard disk ?
Thanks in advance

@officedocsbot assign @yogkumgit

@Obleyer Please provide the name of document you are referring to. Thanks

@Obleyer We appreciate any feedback that improves the content in the Microsoft docs but we haven't had any response from you so we are going to close this issue.
Please feel free to re-open this issue if you see an improvement is required in the specific area of this documentation. We will certainly update this documentation with that valuable information. Thanks again, for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.

https://docs.microsoft.com/en-us/powershell/module/skype/set-csteamsmeetingpolicy?view=skype-ps


cura: 4.0.0 -> 4.1.0

Motivation for this change
New cura version.  cc maintainer @abbradar
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Assured whether relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg eval
@GrahamcOfBorg build cura

Tested on Linux, builds and runs. Thanks!


[On dev branch] New BrownianInterval hangs when dt is very small

I think this relates to the issue @patrick-kidger mentioned that when running the scalar diagnostics, large amounts of memory is consumed. I'm seeing this also on my machine.
I've managed to pinpoint the issue: When tb-ta is very small, the dependency tree creation phase hangs, with _set_points being repeated indefinitely. More specifically, this line.

How small is small? I've tested this down to dt=1e-7 (so 100 times smaller than the default dt_min) and things seem fine. (It terminates in 80 seconds on my machine.)

Good point, I'm observing values of tb - ta to be as small as 1.7763568394002505e-15. This is really a result of the while loop in base_solver.py still stepping forward despite curr_t being set to ts[-1].
This is clearly due to limited floating point precision, though the precise reason I have not figured out yet.

Are you saying there's still a bug in base_solver.py somewhere?
This has made me realise, though that we can get an arbitrarily small timestep on the final step. I'll update the heuristics for creating the dependency tree to be a bit smarter.

That is clearly the case, i.e. curr_t = ts[-1] < out_t=ts[-1].

Can you provide a repro? Just eyeballing the integration code nothing really looks wrong to me.

Can you provide a repro? Just eyeballing the integration code nothing really looks wrong to me.

Try running python -m diagnostics.ito_scalar on branch dev-remove-tuple. The problem occurs regardless of which random seed I use on my machine.
I think ultimately, we should step pass the boundary and pull back later on.

Right, figured it out - this was a bug in BInterval, not in the solver. I'll have a PR in a few moments.


Added a bunch of tags, and organized some stuff

Some notes: the comments use Golang's documentation, so they're visible on godoc.org and using Golang's doc generation tools. They have to follow a specific format; they must start with the function name.

This looks ready to merge as well. Let's just rebase and force-push into a single commit.

Don't merge this yet, I had so many wonderful types of alcohol in Alcohol().... :( On the wrong computer I guess...

Okay, I'm satisfied. :+1:

Merged, thanks!


UTF-8

Please add UTF-8 example

There are already a couple of UTF-8 examples (grammars/test/basic_unicode0.lang, grammars/test/basic_unicode1.lang).


Set fsync=off in gitlab CI

Should speed up tests in CI a bit

This seems to save about 2 minutes from backend tests!
Before: https://gitlab.com/couchers/couchers/-/jobs/1003340831
After: https://gitlab.com/couchers/couchers/-/jobs/1006393636


usage: DiffRowGenerator to compute git-diff like diffs?

Hi!
First thanks for this project, it's quite interesting and useful 👍
I'm trying to use it to compute diff between piece of Java codes and I want to obtain diff like those created by git-diff. The ultimate objective would be to obtain exactly the same, if possible.
So do you have any hint to achieve this objective?
I started with a very simple solution using DiffRowGenerator but maybe there's already something creating to transform a diff-utils patch to a git-patch or something like that?

Using DiffUtils you generate a patch, which is what you want. It's a standard diff like the one of git.

To get a better impression here is a little example:
ist<String> text1=Arrays.asList("this is a test","a test");
List<String> text2=Arrays.asList("this is a testfile","a test");

//generating diff information.
Patch<String> diff = DiffUtils.diff(text1, text2);

//generating unified diff format
List<String> unifiedDiff = UnifiedDiffUtils.generateUnifiedDiff("original-file.txt", "new-file.txt", text1, diff, 0);

unifiedDiff.forEach(System.out::println);

//importing unified diff format from file or here from memory to a Patch
Patch<String> importedPatch = UnifiedDiffUtils.parseUnifiedDiff(unifiedDiff);

//apply patch to original list
List<String> patchedText = DiffUtils.patch(text1, importedPatch);

System.out.println(patchedText);

For a deeper understanding you should look into GenerateUnifiedDiffTest.java. Here a complete roundtrip is tested too. A patch is generated, written as unified diff imported and processed on the original text to get the new text.

Great thanks! I'll have a look at it


DataSpreadsheet: a11y updates

What will this achieve?
The cells in the spreadsheet need some refactoring to following best accessibility guidance on grid components following WAI aria guidelines.
How will success be measured?
Cells/header cells/rows/etc all receive the appropriate aria labels and roles according to WAI aria grid guidelines.

Additional information

Designs
Existing code
etc

Complete


feat: Use RFC 5737 ip addresses

These are "guaranteed" not to work, we can detect these ranges in our usage and help users out if they copy-pasted a bit too much.
Fixes: #10

That's a very nice idea! Especially with the check :)
+1


Firefox 38 enables  and the srcset attribute by default.

https://hg.mozilla.org/mozilla-central/rev/de043394a41d
https://hg.mozilla.org/mozilla-central/rev/f8cb71f5eda1

Thanks!


App - edit: Add backups of previous APK commits

Describe your suggested feature
(Updated my app cuz I just wanna see what's new :" ) I think it would be nice to still have previous versions of this app available for instances like this because the newly released version is kinda buggy and has minor issues. Thanks 🙏🏻
Other details
No response

Hi @napacia,
Thanks for the suggestion! Really sorry for the recent commits/pre-releases recently. I've been configuring the catalog system of the providers and it is currently a mess. Though, I had warned users when turning on pre-release updates that some commits/versions might be app breaking.
Regarding your feature request, I love the idea of this. I will definitely make a new repository in @Flixclusive to save all the archived/backup apks there for previous versions. However, I might not be able to do this feature during this update. Would it be okay if I could postpone it for the next update? Say v2.1.0?
Again, sorry for the inconvenience.

Would it be okay if I could postpone it for the next update? Say v2.1.0?

Yes, of course. I'll just wait for the update you r working on rn. Take your time and thank you for all the efforts you r putting in 🫂

Hi
I have made an archives branch. The CI should automatically upload all apks per pre-release commits. Thanks for this suggestion, really helpful!


Bizarre render bug when Button is used inside CardActionArea

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Current behavior 😯
Codesandbox: https://codesandbox.io/s/happy-monad-5qif8r?file=/app/src/createEmotionCache.ts
Following the remix run example, when using a Button or IconButton inside a Card > CardActionArea - it seems that the server side render puts additional cards outside the layout.
I cannot really describe what I'm seeing, its better to just look at the code sandbox.
Weirdest bug i've seen this year so far.
I'm also not sure where to file the bug report, here or over on @remix-run. But at the moment I feel like its probably something that the CardActionArea is doing that is not fully supported by remix? Either that, or the remix integration example is missing something.
Note: I also tried initialising the emotion cache with prepend: true but this causes my app to render nothing at all.
Expected behavior 🤔
It should not duplicate the render of certain cards
Steps to reproduce 🕹
No response
Context 🔦
No response
Your environment 🌎
No response

Duplicated from closed #31957

I'll close this one and reopen the first one so we save the discussion had there.


Help by starting please...

I want to use this workflow.. I'm very new to Alfred and this is my first try with workflows.
I've tried the steps at the beginning of the readme, but that didn't work.
Then I've read in internet, that I have to download the .alfredworkflow file, but I didn't found it :/
So what I have to do exactly?

You can read more about Alfred Workflows in their help page. And you can download this workflow in the releases page or in Packal.org.
After installing it, then you can follow the instructions from the README.
Hope that helps.

Thanks @edgarjs :)
This was the the first Workflow I've added to Alfred - and the only one that has no link to the workflow file in the readme ;-P (or is it there and I didn't have seen it??)
But now it works properly! Very cool extension for Alfred. Thank you for providing that 👍


Support uint64 expand

Problem
Errors were occurring when trying to process uint64 during variable expansion.
invalid format: evaluated vars.uint64 , but got uint64(4600)

Let uint64 support.
I was able to verify this on a unit test level, but could not reproduce the error when run through RunBook.
I reproduced this when using the brew version, but I wonder if it has anything to do with it?

I'd like to think there are no more leaks elsewhere 😅


Date Range with time

Need help to implement date range with time, After enabling "showTimeSelect" I am able to select a time from the list but I need to disable past time value from the list.

https://reactdatepicker.com/
Scroll down to "filter times" and you should see a reference to what you'll need to remove some time input values

https://reactdatepicker.com/
Scroll down to "filter times" and you should see a reference to what you'll need to remove some time input values

not working

Hi @ndanvers, @martijnrusschen   I found a problem why this is not working. I have the same problem because in npm/yarn we have a version without this commit:
c6bbd1091a4478a918ab3e7fb921baa7d15cb16d in this commit you bind selected day to filtering function, which this solution helping to filter time correctly. Could you publish a version with this fix? Thank you.


experiment: implement basic trampoline for moc ast interpreter

Although we support browser based execution of the moc interpreter, it currently only runs on tiny examples before exhausting the JS stack.
This is because the interpreter is written in CPS and ocaml_js does not honour tail calls to unknown functions, i.e. every call of a (dynamic) continuation.
This PR abuses our existing event loop to implement a simple trampoline for the cps based interpreter, exiting the current interpretation to clear the stack, but resuming it from the front of the event queue.
This allows the js compiled interpreter to run in the browser without running out of stack.
TODO:

[x] only do this JS code, not OCaml native code.
[x] optimize to avoid allocation
[ ] use a stack local counter, or hide it in the environment?
[ ] use a dequeue instead of abusing the queue (for more efficient queue jumping)?

Now, instead of sorting a buffer of 4 elements failing with stack overflow, we can sort hundreds of elements!
Screenshot:
Before:

After:

Ok, this is not a cure. For example

@chenyan-dfinity PTAL - I've merged in @osa1's PR that removes another source of failure (even in the ocaml intpreter).
The while loop above remains problematic, however.


[sil] Rename SILBasicBlock::getParent() -> getFunction().

This is a refactoring that we have talked about for a while with an eye towards
providing a consistent name across all IR constructs for getting its
corresponding SILFunction (if it has one).
This refactoring was done using Xcode's refactoring engine. I then
git-clang-formatted the result and eliminated a couple of places where
clang-format didn't do a good job with ternary operations.

@atrick as you requested. I used Xcode's refactoring support.

@swift-ci smoke test

... and it looks like the dom tree impl requires this.

Yes. We will need to add some sort of indirection upstream. Check this:

  static_assert(std::is_pointer<typename GraphTraits<NodeT *>::NodeRef>::value,
                "Currently DominatorTreeBase supports only pointer nodes");
  using NodeType = NodeT;
  using NodePtr = NodeT *;
  using ParentPtr = decltype(std::declval<NodeT *>()->getParent());
  static_assert(std::is_pointer<ParentPtr>::value,
                "Currently NodeT's parent must be a pointer type");
  using ParentType = typename std::remove_pointer<ParentPtr>::type;

Taken from the impl in GenericDomTree.h.

Really it should be using pointer like type traits and perhaps add something that describes the parent type to graph traits.

@atrick same. I was thinking of doing the dom-tree wrapper, but the is_pointer check got in the way. That being said, I don't understand why it isn't using PointerLikeTypeTraits

Going to close this until we fix something upstream.


Major update to remove Scripts, compatibility with new Sandbox image

Proposed changes
This update:

Removes the Scripts directory, and updates all notebooks to load directly from dea-tools using:

import sys
sys.path.insert(1, '../Tools/')
from dea_tools.datahandling import load_ard

Updates the repository for compatibility with recent updates to the DEA Sandbox image which are currently implemented on the dev Sandbox.

Adds a temporary fix to ensure that dea-tools modules can be imported locally: https://github.com/GeoscienceAustralia/dea-notebooks/blob/sep_update/Tools/dea_tools/init.py

try:
    from .__version__ import version as __version__
except:
    __version__ = None

Closes issues (optional)

Closes #731
Closes #849
Closes #732

I'd like to fix the __version__ hack - basically the version is still totally gettable we just need to use setuptools_scm to do it. This isn't a blocker on getting the PR merged though; I'm happy to have it merged and then do a separate PR for that. Just noting my intent!

(not a review, just a note)

@MatthewJA Can you quickly check this one? Still looks like an error in the middle: https://github.com/GeoscienceAustralia/dea-notebooks/blob/sep_update/Real_world_examples/Subpixel_waterbodies.ipynb (Cell 12)

whoops, I fix

Try now @robbibt

Thanks @MatthewJA - the datetime thing was fine (datetime is a submodule of datetime and it's used here: today = datetime.today()). I've fixed the try/except!


Homepage: More focus on open source

Updates on the homepage, see highlighted areas:

Stroke width of open science logo is too thin. Nice addition otherwise. Not sure if we need the sentence about maintainers on the main homepage

Stroke width of open science logo is too thin.

Updated 👍🏻

I don't see why cloud needs it's own special box

Because people don't read - if I see "portable and reproducible" I don't think "this academic project will work in the cloud". I think it's fairly valuable tbh.
I collapsed the stable versions thing because I thought the same thing about that box - reproducible + CI / CD etc all implies stable releases, I kind of felt that this was a given.
Mind you, if we do add a list of supporters and that includes the AWS logo then I guess that'll get the point across quite nicely as well. In which case we could keep the releases one 🤔

based on the previous discussions

👉🏻  https://github.com/nf-core/website/issues/2657

Because people don't read - if I see "portable and reproducible" I don't think "this academic project will work in the cloud". I think it's fairly valuable tbh.

Mmm, fair enough but I don't think proportionally many academics are using the cloud (well in Europe anyway, I think it's different in the US), Making the Azure/AWS logo clearer (or including that in the portability box) would work indeed

@jfy133 ok - I had a go at reworking the boxes we discussed. Hopefully this is better?

I'd like to leave the "supported by" stuff to another PR if that's ok.

Ok and I tweaked the other strip to address https://github.com/nf-core/website/issues/2657 - hopefully better now:

I just stumbled upon this issue. I like the additions. But I am not sure the fancy animations in the figures are a good idea. They are disturbing me when reading/looking at it because they constantly attract attention and seem to highlight the most important points (but they are not more important than others, I think). Maybe just me who is not used to flashy internet because I block all that stuff in the browser :D

Yeah, you're totally right. In fact most of these icons have remained unchanged since the very start of nf-core. I've had a stab at a refresh:

Thoughts?

Bit more homogenous / boring with the new icons, but I think that's ok?
I tried green icons too, but was worried that it was a bit too much green:

meh, maybe Green is nicer. Pushing that.

 Or do I have to wait longer?

Don't like that the two check marks have slightly different styles/ratio, but that's material icons 😬

Bit more homogenous / boring with the new icons, but I think that's ok?
I tried green icons too, but was worried that it was a bit too much green:

I find the green too strong/distracting from the text actually

Is the deploy preview broken again here @ewels ? Or do I have to wait longer?

I think it breaks whenever I change any CSS. The change was actually just left over from me testing colours and unused, just removed it - hopefully the preview will work again now? 🤞🏻

I think I would stick with grey.

Done

I don't think the iGenomes reference makes here, and certianly by now is not the case. I would consider removing it.

I look forward to when we can be proud of the references we ship again 😓 Updated 👍🏻