Temporarily disable Furo highlighting of current page section

Works around https://github.com/Qiskit/qiskit_sphinx_theme/issues/368 while we wait to see what happens with the upstream PR. For now, it's too complex to vendor the JavaScript code, so we instead disable the problematic feature.
Before:

After:

Thanks, @coruscating. This PR makes me sad, but we agreed in the docs squad meeting with you. No feature is better than a broken feature. And the JavaScript vendoring is Just Too Complex to be worth it, at least for now.


prevent collectives for having 0 admin

Right now, you can remove all admins from a collective. We should prevent this from happening.
Last admin needs to add a new one (that needs to validate the email) before removing themselves.

Another example of how this can happen came through support today.
User wanted to delete his account and his Collective. He deleted his account. But then lost access to delete his Collective, which was left with 0 admins.
We should not allow someone to delete their account if they are the only admin of a Collective.

This is a regular and pretty frustrating issues for our users.
@flickz can you have a look?

Alright I'm on it

Right now, you can remove all admins from a collective. We should prevent this from happening.

I've been thinking about the best logic for this because of the way editMembers  method is currently written, can we establish a ground rule that says:
"As an admin, you can't remove yourself from a collective, you have to inform another admin member of the collective to remove you. Or add a new admin member that can do that for you"
This would prevent a collective at any point in time from having 0 admin.

@flickz Sounds like a sensible option.

Sounds good @flickz - once you confirm how it will work let me know and I can write some help text for you to use when someone needs to be informed why they can't delete themselves.

@alanna can you write the help text now?

@flickz can you confirm how it will work? Will it not ever allow you to remove yourself as an admin, even if there are other admins, or will this only come up if they are the last admin left? When will they see the text?

Also, what will the behaviour be when someone is trying to delete their own account but they are the only admin of a Collective or Organization?

Will it not ever allow you to remove yourself as an admin, even if there are other admins

Yes this is happens.

Also, what will the behaviour be when someone is trying to delete their own account but they are the only admin of a Collective or Organization?

Currently this only prevents you from removing yourself as an admin. I'm thinking about making the
account deletion a separate PR, @znarf What do you think?

When will they see the text?

@flickz Can you answer this question from @alanna ? Maybe share a screenshot with the error message.

I'm thinking about making the account deletion a separate PR,

@flickz Yes, let's do it separated.

When will they see the text?

@alanna The error message is shown when the user click save in the edit collective page, like the screenshot below:

For the account deletion, this is shown in the advanced section of the edit collective page after the Delete button from the modal confirmation is clicked.

OK. So I am understanding that no one can ever remove themselves as an admin, even if there are other admins. If that's right, here's some text for the error messages.
Core Contributors screen:

You cannot remove yourself as a Collective admin. If you are the only admin, please add a new one and ask them to remove you.

 Please archive or delete that Collective, or add another admin.

Re-opening as there is a path that https://github.com/opencollective/opencollective-api/pull/2386 doesn't cover: if users change their roles from Collective Admin to Core Contributor, they will still loose the access to their collective. We only prevent the remove, not the edit.
See https://opencollective.slack.com/archives/C0HSLRNVC/p1566257208170100

@flickz can you take care of that?

Sure

Merged and deployed.

Hello, I have an issue that seems to be related to this. I've created an user account and changed the username, but received the following message: "There must always be at least one collective admin". The settings got changed tho.
But now I wanted to change profile picture and that doesn't seem to work, I get that message everytime.

@hugonun we'll look into it, what's your collective or user account?

@znarf Thanks, here is my account: https://opencollective.com/hugonun

@hugonun Thank you for the report, should be fixed.


Remove #TODOs and config.nu usage relicts

Basically go through the code and:

[ ] remove (or solve) all the TODOs (e.g. modules/nupac.nu/L221)
[ ] rename variables like add-to-config (e.g. modules/nupac.nu/L266) to something closer to the actual nupac's workflow

@Yethal could you take care of it as the main refactorer of these lines here?


@kmjennison yeah v9 of the firebase sdk.

@kmjennison yeah v9 of the firebase sdk.
Originally posted by @Dnguye92 in https://github.com/gladly-team/next-firebase-auth/discussions/97#discussioncomment-2011955
next-firebase-auth": "^1.0.0-canary.11", I am using this and I also have the same error do you know of any solution

next-firebase-auth": "^1.0.0-canary.11", I am using this and I also have the same error do you know of any solution


Improve the preview card when sharing to social media

Add and improve metadata tags to allow for richer previews when sharing to Facebook, Twitter, Slack, etc.

This is working! When you share  URL on the site to social media (or Slack), either the description (if explicitly set in a page's frontmatter using description:) or the page's summary, or first 70 words, are now shown. In addition, if it's a blog and an image is detected, that image is shown, and its alt text is set to the site title.
Before

After

This will be great for SEO and for sharing on social media. The downside is that the summary is just the HTML with all tags stripped out. I think this is OK because people don't need to read the whole 70 words -- the first couple sentences in a topic should let them know whether they want to click the shared link or not.

@mistyhacks Neat! ✨

The downside is that the summary is just the HTML with all tags stripped out.

Agreed, testing shows it's mostly keyword salad. But SEO should definitely improve, and yes, the textual hint will hopefully be more helpful.
/lgtm
/approve

@mistyhacks I think there is currently a problem with the Summary generation in hugo. What default solution could we have if no description is specified?

@remyleone Misty’s no longer involved in Kubernetes.


Colors are not correct when dark mode is disabled

Fixed in branch dark-beta

Fixed in branch dark-beta


Log doesn't display after flash

Serial doesn't reconnect at proper speed after a flash and so the log doesn't show properly.
Viewing the log works if you close the program and re-open it.

fixed


Added a sed port

The code looks good but can you remove the merge commit by rebasing / cherry-picking?

Great, thank!


MorphTo relation won't work when eager load if target model has different primary key

Laravel Version: 10.44.0
Laravel-mongodb Version: 4.1
PHP Version:  8.2.10
Database Driver & Version: 7.0.5

Description:
Follow #2669
If morphTo() is defined on model with $primaryKey='_id' and target model has $primaryKey='id' it will return null when eager load
Steps to reproduce

I have model with morphTo relationship, here is Entities model, having primaryKey=_id (Unmodified)

class Entities extends Model
{
    use HasFactory;

    public function source(): MorphTo
    {
        return $this->morphTo(__FUNCTION__, 'source_model', 'source_id');
    }
}

and the target model if auto increamented ID, here is what is looks like
class Client extends Model
{
    use HasFactory, AutoIncreamentTrait;

	protected $primaryKey = 'id';
}

When calling the relation via eager load, it returns null,

Entities::with('source')->find('65f435eecd749d48b70b5c6b');

Expected behaviour
It should return the source as relation
{
    "_id": "65f435eecd749d48b70b5c6b",
    "source_id": 1,
    "source_model": "App\\Models\\Client",
    "assign_date": "2024-02-25T00:00:00.000000Z",
    "unassign_date": null,
    "notes": null,
    "updated_at": "2024-03-15T11:50:06.217000Z",
    "created_at": "2024-03-15T11:50:06.217000Z",
    "status": "active",
    "source": {
		"_id": "65f2ec6d28c0daeb6e010c60",
		"id": 1,
		"name": "Anthony Rowe",
		"email"<EMAIL_ADDRESS>		"updated_at": "2024-03-15T11:50:06.217000Z",
		"created_at": "2024-03-15T11:50:06.217000Z",
	}
}

Actual behaviour
Instead, it returns null
{
    "_id": "65f435eecd749d48b70b5c6b",
    "source_id": 1,
    "source_model": "App\\Models\\Client",
    "assign_date": "2024-02-25T00:00:00.000000Z",
    "unassign_date": null,
    "notes": null,
    "updated_at": "2024-03-15T11:50:06.217000Z",
    "created_at": "2024-03-15T11:50:06.217000Z",
    "status": "active",
    "source": null
}

Proposed Solution
Below is what seems to be problem
as per this commit: https://github.com/mongodb/laravel-mongodb/pull/2669/commits/4c03ea820280c8d412d7a31e6d12a794cc928408

$this points to current model which is in this case Entities::class which is wrong since it should get the ownerKey of target model, in this case Client. So solution would be just pass the null as $ownerKey, laravel will pick the ownerKey by it self. I already tested it

Tracked in Jira PHPORM-175

This should be fixed by https://github.com/mongodb/laravel-mongodb/pull/3011. I incorporated the OP's code sample into a regression test.

Thanks @jmikola. I have tested it on my original production site and can confirmed that the issue has been fixed.


Provide configuration guidelines for BufferedStorageBackend settings

What problem does your feature solve?
In #4911, we added an option for Horizon to reingest historical ledgers from the datastore using BufferedStorageBackend.
BufferedStorageBackend has a BufferSize that specifies the number of ledgers to hold in memory and a NumWorkers  to specify the number of parallel download workers. We need to run tests and benchmark to identify the optimal configuration values.
What would you like to see?
Configuration guidelines for BufferedStorageBackend.
What alternatives are there?
Let users find the best settings through experimentation.

Reingestion times for 10,000 ledgers with various configurations of LedgersPerFile, Buffer Size, and Num Workers:

LedgersPerFile
Buffer Size
Num Workers
Time Taken

1
1
1
34m58s

1
5
1
30m4s

1
10
1
27m50s

1
100
1
20m41s

1
500
1
19m42s

1
5
5
17m20s

1
10
5
17m20s

1
100
5
17m1s

1
500
5
16m55s

1
10
10
18m26s

1
100
10
22m2s

1
500
10
19m40s

1
100
20
18m10s

1
500
20
19m24s

100
1
1
18m49s

100
5
1
17m29s

100
10
1
17m10s

100
100
1
18m24s

100
500
1
17m25s

100
5
5
16m56s

100
10
5
16m54s

100
100
5
17m53s

100
500
5
18m3s

100
10
10
19m43s

100
100
10
19m9s

100
500
10
20m0s

100
100
20
18m51s

100
500
20
19m46s

1000
1
1
23m13s

1000
5
1
22m51s

1000
10
1
22m24s

1000
100
1
22m52s

1000
500
1
22m54s

1000
5
5
22m47s

1000
10
5
22m54s

1000
100
5
22m57s

1000
500
5
24m6s

1000
10
10
26m0s

1000
100
10
23m32s

1000
500
10
23m47s

1000
20
10
23m39s

1000
500
20
24m15s

Summary

LedgersPerFile: 1:

Best performance: Buffer Size: 500, Num Workers: 5
Time taken: 16m55s

LedgersPerFile: 100:

Best performance: Buffer Size: 10, Num Workers: 5
Time taken: 16m54s

LedgersPerFile: 1000:

Best performance: Buffer Size: 10, Num Workers: 1
Time taken: 22m24s

Recommendations

For small number of LedgersPerFile (1 LedgersPerFile):

Use Buffer Size: 500 and Num Workers: 5 for the fastest processing time.

For medium number of LedgersPerFile  (100 LedgersPerFile):

Use Buffer Size: 10 and Num Workers: 5 for the fastest processing time.

For large number of LedgersPerFile  (1000 LedgersPerFile):

Use Buffer Size: 10 and Num Workers: 1 for the fastest processing time.
Note: Logically, for larger LedgersPerFile values, 1 worker and a buffer size of 2 should be sufficient. However, I tested with a buffer size of 1 and then directly with 10. I will run a test with 1 worker and a buffer size of 2 and update the results.

Note: Logically, for larger LedgersPerFile values, 1 worker and a buffer size of 2 should be sufficient. However, I tested with a buffer size of 1 and then directly with 10. I will run a test with 1 worker and a buffer size of 2 and update the results.

Additional tests for LedgersPerFile: 1000 with a smaller buffer size did not result in better performance.

Buffer size: 2, Num workers: 1, Time taken: 23m 58s
Buffer size: 2, Num workers: 2, Time taken: 23m 52s

Following Tamir's advice, I moved the tests to a dev EC2 instance. The performance was much worse: a test that takes 30 minutes locally for 10,000 ledgers took over 7 hours on the EC2. We found that I/O was the problem so as per Ops suggestion we upgraded to a larger gp3 volume and I moved PostgreSQL to use this new volume. It improved the time to about 1 hour for smaller buffer sizes but larger buffers led to oom errors.
I then modified the tests to use the BufferedStorageBackend directly to download and extract ledgers with varying buffer sizes and parallel workers, without reingesting through Horizon (and thus without PostgreSQL). This cut the processing time to about 20 minutes for 10,000 ledgers, but it’s still much slower compared to 3 minutes locally. This suggests the dev EC2 (t2.medium) are too small for these tests.
I’ve also run the same BufferedStorageBackend tests locally with different settings. The results match those from the previous Horizon-based tests. I’ll review all the data and provide a summary with configuration recommendations.

We've added the recommended config values for BufferedStorageBackend in this PR https://github.com/stellar/go/pull/5462/files#diff-052e43536000d43e8d99a272431cf8b323816b05bf59b7501392f2313276c763R29.

The guidelines can be doc'd as part of this request for new dev docs related to CDP - https://github.com/stellar/stellar-docs/issues/1012


jobTitle , department and manager is not supported through custom claims via directory extensions

i couldn't retrieve jobtitle and department attributes by using directory extension as explained above.
the code is not reflecting on the token
"optionalClaims": {
"idToken": [
{
"name": "extension_38exy3a9-bad5-xxxx-xxx-xxxxxxx_jobTitle",
"source": "user",
"essential": true,
"additionalProperties": []
}
],
"accessToken": [],
"saml2Token": []
},

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1d8e93d6-413b-34aa-3359-41f5baa442d3
Version Independent ID: 0d657318-8058-a76a-c219-393ab3a4920d
Content: Learn how to provide optional claims to your Azure AD application
Content Source: articles/active-directory/develop/active-directory-optional-claims.md
Service: active-directory
GitHub Login: @CelesteDG
Microsoft Alias: celested

@omniayehia8 Thank you for your feedback! We will investigate and get back to you with our findings.

@omniayehia8 Can you confirm if you created the extensions using graph.windows.net as described in the article?

would you please clarify more ?

@omniayehia8 I wanted to confirm you created the attributes as described in the Directory schema extensions article. The directory extensions described in this article are created using Graph (specifically Azure AD Graph API) and not through AD Connect schema extensions as described here.
can you confirm this ?

Hi Manoj,
yeah i created the extension attribute using the graph and it is working while testing with the user had a value on that extension attribute with the same tenant only , so i have two Questions here:
1: the extension attribute only shown if we put a value manually to that attribute for each user using graph.windows.net, Is there a way to make this extension attribute pointed to another attribute in the directory, therefore the value will be taken automatically instead of setting the attribute manually using graph.windows.net ?
2: as per first Question, it is not work when authenticating users from another tenant (doesn’t fit for multi-tenant applications)?

@omniayehia8 Thanks for the confirmation.

There is no automated way of achieving this. You would have to leverage graph API to pull the source attribute and then update the extension attribute accordingly.

example : Write a PS script which invokes graph calls and then do a get request for all the users to pull the source attribute and when it's not null, update the target attribute.

These extension attributes should be available for multi tenant applications as well. Check this example described for this exact scenario.

As described in the above article, make sure an administrator has consented for this application and the attribute is not null in the other tenant's user object.

@omniayehia8 We have not heard from you in a while.We will now proceed to close this thread. If you have further questions, please tag me in the comments and I will gladly continue the conversation.


Open Payments v2 incoming-payment

Support Open Payments v2 incoming-payment with existing IncomingPaymentService and API routes.

rename properties
add states
Add STREAM receipt support

Depends on this issue


🐞 - Regression with postfix

Which @taiga-ui/* package(s) are the source of the bug?
core
Please provide a link to a minimal reproduction of the bug
https://stackblitz.com/edit/taiga-starter
Is this issue blocking you?
Blocking
Description

Angular version
latest
Taiga UI version
latest
Which browsers have you used?

[X] Chrome
[ ] Firefox
[ ] Safari
[ ] Edge

Which operating systems have you used?

[X] macOS
[ ] Windows
[ ] Linux
[ ] iOS
[ ] Android

regression
https://github.com/Tinkoff/taiga-ui/pull/1551


Compiling help: "source/funkin/system/CoolUtil.hx:242: characters 10-14 : Unmatched patterns: NONE"

Please check for duplicates or similar compiler issues by filtering for 'compiler help'

[x] Windows
[ ] Mac
[ ] Linux
[ ] HTML5

Please describe your issue. Provide extensive detail and images if possible.
Every time I run lime build windows, "source/funkin/system/CoolUtil.hx:242: characters 10-14 : Unmatched patterns: NONE" pops up. This just started happening, and it might be related to a recent commit but I'm not too sure. Does this happen for any of you?

When I "fix" the issue by removing the switch statement, I get this. "source/funkin/scripting/Script.hx:44: characters 36-56 : Cannot use abstract as value"

I found out this is because Yoshi is making big changes to their Flixel fork

It should work now,
Make sure to run update.bat since i updated both hscript-improved and the flixel fork

Thank you


Consider using the single page viewer for presentation mode

In pull request #8724 a single page viewer has been implemented. It should be possible to use this for presentation mode, which may simplify the current code.

Sorry, but I'm really not convinced that think this qualifies as a good beginner bug since there's a lot of state you'd need to transfer between the PDFViewer/PDFSinglePageViewer instances (which doesn't entirely simple/straightforward to me at least...).

I thought this would be relatively easy at first, but that is indeed a potential problem. Removing the label.


Allocation failure with different cluster types on North Europe

For three days I can't start clusters on North Europe, allocation failures. Points me to this site http://aka.ms/allocation-guidance where I find no help. Are there problems with the North Europe VMs?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a1b587f6-8bf4-fb64-5515-be223a17f783
Version Independent ID: a756c758-417c-974d-1787-ad5e61edbd0b
Content: Troubleshooting Azure VM allocation failures
Content Source: articles/virtual-machines/troubleshooting/allocation-failure.md
Service: virtual-machines
GitHub Login: @JiangChen79
Microsoft Alias: cjiang

@jwbliden Thanks for the question. We are investigating the issue and will update you shortly.

@jwbliden We are having capacity issues in few region for some VM sizes.
You can try to change the VM size and try to see if that helps. However, you can reach to support to know on this more.
Please see this blog post for more information.
As this is a know capacity issue, I will proceed to close the issue. If there are further questions regarding this, please tag me in a comment. I will reopen it and we will continue the discussion.


quantization

can i use this tool to quantize a self-defined model, for example, a mobilenet v2 with deconv op or upsample operation

Hi @leonzgtee ,
The way we quantize models is by taking from them each leaf module we want to quantize, creating a wrapper around them and replacing the leaf module with the respective wrapper.
For example, if we'd want to quantize a model with nn.Conv2ds, we'd create a wrapper class around it like QuantizedConv2d, and replace the original nn.Conv2d object by the QuantizedConv2d wrapper object.
Fortunately, we have already implemented this for most modules, as you can see in the implementation of PostTrainLinearQuantizer. There you can see that the quantizer holds a dictionary replacement_factory, which takes a type of module as a key and outputs a function (which takes the module itself, its name and several configuration arguments) that will create a wrapper around the module and replace with it in the original model.
https://github.com/NervanaSystems/distiller/blob/112163eb8eb8f53bc7783250b5d1e4f41109e515/distiller/quantization/range_linear.py#L875-L876
So quantizing nn.ConvTransposed2d would usually be done by adding
quantizer.replacement_factory[nn.ConvTransposed2d] = replace_param_layer

However the class RangeLinearQuantParamLayerWrapper doesn't accept a nn.ConvTransposed2d layer yet (will raise ValueError). A quick work around is to add in your revision the nn.ConvTransposed2d layer into the acceptable RangeLinearQuantParamLayerWrapper layers in the code, you should be fine since deconv op is a linear op.
If you want to quantize using a yaml configuration, I suggest writing a custom quantizer class in the same way described above.
Let us know if you have more question.
Lev

thanks for your reply. but there are still something unclear for me . i conduct some research on the quantization of centerNet, a fast model used for object detection .it's backbone net is mobilenet v2 and contain some extra operations such as postproces,  if i want to quantize this model, can i transfer the whle model into the tool. besides, i have noticed that the tool use cifar and imagenet to evalute the performance of a quantized model, how can i use a coco format data to evaluate my model. looking forward to your reply.

The compress_classifier.py indeed uses only cifar10/imagenet datasets and only compresses classification models. However the framework is valid for object detection models as well, and the code should be pretty similar to compress_classifier.py.
I am actually working on adding an example of compressing object detection models, should be done soon enough, and you could use the sample for your research :)
In the meantime, you could write a script for quantizing and evaluating your model using the PostTrainLinearQuantizer class.
The loop of quantizing the model is:

Implementing the model by using a separate module for each operation in .forward - this is to allow the quantizer to actually find the operations and be able to quantize them.
For example:
if the original forward was

def forward(self, x):
     x = self.conv1(x)
     x = F.relu(x)
     ...

You should add nn.ReLU in the ctor like self.relu1 = nn.ReLU() and in forward call the module function:
def forward(self, x):
     x = self.conv1(x)
     x = self.relu1(x)
     ...

Define the quantizer - we have plenty of quantizers implemented, chose the one you need and provide it with the configuration of bit widths for activations, weights and accumulator. Then call quantizer.prepare_model() and the model is transformed into its quantized counterpart.
Train/Evaluate the model using the regular loop for a non quantized model.

For more info, check out our docs and examples.
Thanks,
Lev

Hi,
I think I get a relevant but somewhat fundamental question.
In my experiment, I first pretrain my own vgg16 with batch norm on cifar10, which reaches acc 90%.
Then, I use the following code to quantize my model:
 # x_dat is the input data of a batch.
 model.eval()
 quantizer = quantization.PostTrainLinearQuantizer(model, bits_activations=32, bits_parameters = 32)
 quantizer.prepare_model(distiller.get_dummy_input(dataset = None, device = None, input_shape = x_dat.shape))

out of my expectation, when I evaluate on the test data, the acc drop to 0.1. I expect that 32 bit quantization should leads to the original accuracy. When I try bits to be 8, the accuracy is almost the same as the original one.
Am I ignoring any setup for this default quantizer ?

Hi @levzlotnik
Thanks for your clear description of how quantization works in Distiller. I have been looking for this description on your Documentation page for days!
I only have one humble request if you could group all quantization-related things in one category in your documentation page. I think it would be convenient for dummies like me to search for key information on your documentation. In my opinion, the Design section on the list should be expanded so that readers can easily look up.
Thanks.

Hi @leonzgtee ,
I indeed think you're right, we should clarify the things I've explained here. We've talked about it in our team and we agreed we'll add another FAQ section and probably more clarity to this design.
Thank you for your remark, we'll probably update the docs sometime near in the future.
Thanks,
Lev

The compress_classifier.py indeed uses only cifar10/imagenet datasets and only compresses classification models. However the framework is valid for object detection models as well, and the code should be pretty similar to compress_classifier.py.
I am actually working on adding an example of compressing object detection models, should be done soon enough, and you could use the sample for your research :)
In the meantime, you could write a script for quantizing and evaluating your model using the PostTrainLinearQuantizer class.
The loop of quantizing the model is:

Implementing the model by using a separate module for each operation in .forward - this is to allow the quantizer to actually find the operations and be able to quantize them.
For example:
if the original forward was

def forward(self, x):
     x = self.conv1(x)
     x = F.relu(x)
     ...

You should add nn.ReLU in the ctor like self.relu1 = nn.ReLU() and in forward call the module function:
def forward(self, x):
     x = self.conv1(x)
     x = self.relu1(x)
     ...

Define the quantizer - we have plenty of quantizers implemented, chose the one you need and provide it with the configuration of bit widths for activations, weights and accumulator. Then call quantizer.prepare_model() and the model is transformed into its quantized counterpart.
Train/Evaluate the model using the regular loop for a non quantized model.

For more info, check out our docs and examples.
Thanks,
Lev

Hello! Thanks for your efforts of working out examples of detection models.
The distiller is awesome and I am also looking for a proper way to use distiller to prune my detection models. Look forward to your update

@lehahoang, I added a section on preparing a model for quantization to our docs. You can find it here. I hope you and others find it useful. I'm closing this issue for now.
(It's another separate section :) But it's top-level so should be easy to find. It's also linked from the README and FAQ. I think our docs need a general refactoring, but that's something for another day...)

@guyjacob @levzlotnik @leonzgtee
I added @leonzgtee's question and @levzlotnik's reply to the FAQ.
Cheers
Neta


Today Button Functionality Not Working on Different Months and Year

For Eg: I go to different year or month and click on "Today Button" it doesn't goes to and highlight Today's Date.

@dineshdedhia
Yes, thanks.
The bug has been fixed. Update the picker package and It should be all right.

Hello @DanielYKPan
Thanks Its done :)
Thanks once again


The assignment operator := doesn't behave correctly in the REPL

Works correctly when executing via lsc: the variable a gets changed to value 3:
geza$ cat foo2.ls
a = 5
f = -> a := 3
f()
console.log a
geza$ lsc foo2.ls
3
However, if executing these same lines in the REPL, the variable a keeps its original value of 5:
geza$ lsc
LiveScript 1.2.0 - use 'lsc --help' for more information
ls> a = 5
5
ls> f = -> a := 3
[Function]
function (){
return a = 3;
}
ls> f()
3
ls> console.log a
5
undefined

Can be closed.


Build(deps-dev): Bump @types/lodash from 4.14.182 to 4.14.183 (#3901)

Pull request opened by the merge tool on behalf of #3901

Merged in 89b0b7e052dab2e87245f3fd7123c048de5c7534


Upgrading Notebooks to Atoti Python API version 0.8.11

This PR updates the poetry.lock file using poetry update and upgrades all academy and technical use case guides, along with attempted upgrades for several (15/35) use case finance notebooks to version 0.8.11. READMEs will also be updated accordingly.

Note: I used find . -name "*.ipynb" | sort at the root of the repo to obtain the below list of notebooks.

Upgraded Notebooks

[x] ./01-atoti-academy/introduction-to-atoti/main.ipynb

[x] NEEDS FIX: Whitespacing + style edits
[x] NEEDS FIX: Centered LaTeX expressions (had to move them to their own code blocks to prevent rendering issue)
[ ] NEEDS FIX: Broken widget filters

[x] ./01-atoti-academy/storytelling-with-atoti/01-Storytelling.ipynb

[x] NEEDS FIX: Whitespacing + style edits
[x] NEEDS FIX: Deprecated functions

[x] ./01-atoti-academy/storytelling-with-atoti/02-Storytelling.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./01-atoti-academy/storytelling-with-atoti/03-Storytelling.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./02-technical-guides/aggregate-provider/main.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./02-technical-guides/auto-cube/main-advanced.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./02-technical-guides/auto-cube/main.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./02-technical-guides/conditional-functions/main.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./02-technical-guides/currency-conv-with-weighted-ave/main.ipynb

[x] NEEDS FIX: Whitespacing + style edits
[x] NEEDS FIX: Deprecated functions

[x] ./02-technical-guides/currency-conversion-with-lookup/main.ipynb
[x] ./02-technical-guides/currency-conversion/main.ipynb
[ ] ./02-technical-guides/directquery-intro/main.ipynb
[ ] ./02-technical-guides/directquery-vector/main.ipynb <-- Skipping, see 0.8.9 PR
[x] ./02-technical-guides/excel-and-atoti/main.ipynb
[x] ./02-technical-guides/internationalization/main.ipynb
[x] ./02-technical-guides/introductory-tutorial/main.ipynb
[x] ./02-technical-guides/multidimensional-analysis/main.ipynb
[x] ./02-technical-guides/rollup-hierarchies/main.ipynb
[x] ./02-technical-guides/security-implementation/01-Basic-authentication.ipynb
[ ] ./02-technical-guides/security-implementation/02-OIDC-Auth0.ipynb <-- Skipping, see 0.8.9 PR
[ ] ./02-technical-guides/security-implementation/03-OIDC-Google.ipynb <-- Skipping, see 0.8.9 PR
[x] ./02-technical-guides/security-implementation/04-LDAP.ipynb
[x] ./02-technical-guides/security-implementation/main.ipynb
[x] ./02-technical-guides/table-creation-and-data-loads/main.ipynb
[x] ./02-technical-guides/topcount/atoti.ipynb
[x] ./02-technical-guides/topcount/pandas.ipynb
[ ] ./02-technical-guides/var-benchmark/data_generator.ipynb <-- Skipping, see 0.8.9 PR
[ ] ./02-technical-guides/var-benchmark/main.ipynb <-- Skipping, see 0.8.9 PR
[ ] ./02-technical-guides/virtual-hierarchies/main.ipynb <-- Skipping, see 0.8.9 PR
[x] ./02-technical-guides/weighted-averages/main.ipynb

[x] NEEDS FIX: Whitespacing + style edits

[x] ./03-use-cases/01-finance/front-office/cumulative-pnl/main.ipynb

[x] NEEDS FIX: Deprecated functions

[x] ./03-use-cases/01-finance/front-office/pnl-explained/main.ipynb

[x] NEEDS FIX: Broken links
[x] NEEDS FIX: Deprecated functions
[x] NEEDS FIX: Whitespacing + style edits

[x] ./03-use-cases/01-finance/front-office/real-time-risk/main.ipynb

[x] NEEDS FIX: Broken links
[x] NEEDS FIX: Deprecated functions
[x] NEEDS FIX: Whitespacing + style edits
[x] NEEDS FIX: Needs data files added to .gitignore

[ ] ./03-use-cases/01-finance/insurance/customer360/01-Dataupload-to-Vertica.ipynb <-- Needs DB setup
[ ] ./03-use-cases/01-finance/insurance/customer360/02-main-vertica-db.ipynb <-- Needs DB setup
[ ] ./03-use-cases/01-finance/insurance/customer360/03-main-csv.ipynb <-- Notebook crashes, most likely OOM

[x] NEEDS FIX: Broken links
[x] NEEDS FIX: Deprecated functions
[x] NEEDS FIX: Whitespacing + style edits

[x] ./03-use-cases/01-finance/insurance/price-elasticity/main.ipynb

[x] NEEDS FIX: Deprecated functions
[x] NEEDS FIX: Whitespacing + style edits
[x] NEEDS FIX: Wrong banner UTM

[ ] ./03-use-cases/01-finance/portfolio-management/alt-data/01_data_gen.ipynb <-- Needs CloudQuant API Key
[ ] ./03-use-cases/01-finance/portfolio-management/alt-data/main.ipynb <-- No plugin of type "widget" was found
[x] ./03-use-cases/01-finance/portfolio-management/cvar-optimizer/01_data_generation.ipynb
[x] ./03-use-cases/01-finance/portfolio-management/cvar-optimizer/main.ipynb

[x] NEEDS FIX: Broken links

[ ] ./03-use-cases/01-finance/portfolio-management/optimize-with-constraints/main.ipynb <-- No plugin of type "widget" was found
[x] ./03-use-cases/01-finance/quantitative-strategy/bucket-analysis/main.ipynb
[ ] ./03-use-cases/01-finance/retail-banking/credit-card-analytics/cc_data_processing.ipynb
[ ] ./03-use-cases/01-finance/retail-banking/credit-card-analytics/main.ipynb

I removed ToC/indexes that reside in the introduction of several notebooks because I learned that JupyterLab automatically generates a ToC (out-of-the-box) here:


Boost the delay between command input and profile actually switching

Hello, first, thanks to your documentation, everything worked fine almost immediatly. Using Swagger UI for open-cue-service switch profile flawlessly and instantly. However, there is a small delay (up to one second) between the console input using open-cue-cli and the profile switching. Is there any way to speed up things ? (it will probably impact performance) Thanks for your help.

This is probably because of the startup time of the JVM, which starts every time the command is executed.

This is probably because of the startup time of the JVM, which starts every time the command is executed.

I see, thank you for your help. So I am now directly posting on cue-open-service with a post request and it works like a charm. Seems like I took an extra step when I wanted to add this repo to the chain !

I see, thank you for your help. So I am now directly posting on cue-open-service with a post request and it works like a charm. Seems like I took an extra step when I wanted to add this repo to the chain !


sampler and source in GLTFTexture are being treated as required attributes by the wrapper

Encountering an error when creating an object that does not have a defined sampler and/or source.
System.NullReferenceException: 'Object reference not set to an instance of an object.'
Use the  stevk/mattextures brance to reproduce this issue.

Taking a look.

So it looks like the wrapper assumes the sampler is already defined when using a texture on a material.  I'll change the behavior where it won't use a sampler if it does not exist.

Going to work on this as a separate PR since it might involve a little more code tweaking

That is fine with me. I'm making local commits to my local copy of the 'stevk/mattextures' branch but I'll leave the code on the server in place so you have an easy repro.

Sounds good, thanks!

PR created #25

Merged


Using window on server side

Hey,
I would like to make a file called variables.js that expose some helpers.
In those helpers I would like to use one called :
export const isMobile = typeof window !== "undefined" ? window.matchMedia("(min-width: 1000px)") : false;
I would like to know if there is a proper way to deal with that ? Am I wrong ?
BEst regards

You can create a Middleware  that will be executed on each page change (or a Plugin with ssr false but executed  only for each application init).
Then add isMobile in the nuxt context (or a better way, in Store)
// middleware/device.js

export default function (context) {
  context.isMobile = (process.client) ? window.matchMedia("(min-width: 1000px)") : false
}

// page/index.vue

export default {
  async asyncData ({ isMobile }) {
    // ...
  }
}

@NicoPennec Thanks you very much. :)


added Timable

I probably broke some temporal inference code
OutputContainsCondition FAIL: No substring match: (&/,<(,SELF,{t001}) --> at>,+100,(^open,{SELF},{t001}))! :!100: %1.00;0.73%
similar(1): (&/,<(,SELF,{t001}) --> at>,+100,(^open,{SELF},{t001}))! :!101: %1.00;0.73%
similar(2): (&/,<(,SELF,{t001}) --> at>,+100,(^open,{SELF},{t001}))! :!201: %1.00;0.73%
similar(4): (&/,<(,SELF,{t001}) --> at>,+100,(^open,{SELF},{t001}))! :!462: %1.00;0.70%
similar(5): (&/,<(,SELF,{t001}) --> at>,+100,(^open,{SELF},{t001}))! :!797: %1.00;0.68%
similar(8): (&/,<(,SELF,{t001}) --> at>,+100,(^open,{SELF},{t001}))! %1.00;0.43%


deps: updates wazero to 1.0.0-rc.2

This updates wazero to 1.0.0-rc.2 which notably

is the final release candidate before 1.0 next Friday.
improves instantiation performance (startup time)
passes os package tests defined by Go.
no longer supports importing unnamed modules.

thanks @pkedy? mind cutting a version?


Create License NFTs

8  Bounty
Need to load the licenses from SPDX License List into ntf.storage as JSON NFTs that we can then reference from the SBOMs. SPDX License List as JSON
    {
      "reference": "https://spdx.org/licenses/BSD-3-Clause.html",
      "isDeprecatedLicenseId": false,
      "detailsUrl": "https://spdx.org/licenses/BSD-3-Clause.json",
      "referenceNumber": 213,
      "name": "BSD 3-Clause \"New\" or \"Revised\" License",
      "licenseId": "BSD-3-Clause",
      "seeAlso": [
        "https://opensource.org/licenses/BSD-3-Clause"
      ],
      "isOsiApproved": true,
      "isFsfLibre": true
    },

The JSON in the NFT should be minimized #525,  #526.
The IPFS CIDs saved associating the licenseId to the CID so we can reference the NFTs later.


Exception: Cannot create project: 200

###openrefine request logs

###phpunit code copy from github

###request result


Not exporting the linked content of a note

I'm using Obsidian to export a note as an HTML file, for my newsletter. Having a home page that gathers content from multiple notes is useful for me, thus using ![[note]] to get the content of another note is very helpful for me. But when exporting to HTML using your nice plugin, I get a blank area instead of the content. Is there another way to get this functionality? Will it be possible to get the content of another note on export, when using ![[note]]? Thanks!

Hi thanks, this is a duplicate of issue #207


Not supported api-version

Hi,
I'm trying to connect with latest version (4.0.99 at the time of writing) of Service Bus Explorer to locally installed Service Bus 1.1 (running on Windows 10) and I'm getting  following message: "The api-version in the query string is not supported. Either remove it from the Uri or use one of '2012-03,2012-08,2013-04,2013-07'".
I see a lots of people ask about this one, but can't get a better answer then using an older version of Service Bus Explorer, like 2.1 which used an older api-version, like 2013-07.
Do you have a plans of fixing the api-version issue?
Thanks in advance!
/S.

Hi @stjepan Service Bus Explorer tool stopped supporting Service Bus for Windows Server 1.1 from version 2.2. The only version of the tool that supports SB 1.1 is available at: https://github.com/paolosalvatori/ServiceBusExplorer/tree/support-2.1

Then I know!
Thank for the quick answer!

FWIW: #119


Refactor to separate lib and CLI?

Howdy @jspaaks 👋,
I'm currently working on a project aiming to automate compiling software metadata from different sources in a source code repo, including CITATION.cff. The internal data model is based on CodeMeta, and I'd like to use cffconvert programatically to do the CFF-CM conversion.
Currently, the architecture of cffconvert makes that a bit cumbersome, as it is intended to be used as CLI only, so I'm wondering whether it would be possible to refactor the conversion logic to a separate library package, or an API module, that both cffconvert CLI and third-party packages can use?
Personally, I have some resources to work on this, and the possibility to enlist some further help (both to an extent), but first would like to assess whether this is something that would be a) useful and b) possible.

Okay, just experimented again, and, given a CFF file, this actually only boils down to
citation = cffconvert.cli.create_citation.create_citation(infile, None)
codemeta_str = citation.as_schemaorg()

Fair enough, although a dedicated API would be nicer to work with, e.g., codemeta_str = cffconvert.convert(cff_dict, 'CodeMeta') (and the dependency would be smaller if cffconvertlib was an extra package...).
Happy to discuss this further, or for the issue to be closed if it is decided it's good enough as is.

Maybe I should document the API :)

Yes, or that 😆.

I think I would use cffconvert like this for your use case:
from cffconvert import Citation
with open('CITATION.cff', 'rt') as f:
    cffstr = f.read()
codemeta_str = Citation(cffstr).as_codemeta()

👍
Feel free to close as my immediate concern is solved, or leave open if such a refactoring is something that would be useful...

Closing for now, the refactoring that I've done recently in #345 and #350 is probably as much as I want to have for the moment.


[1.9.x] [MRESOLVER-571] Import o.e.aether packages with the exact same version

The documentation states that only maven-resolver artifacts of the exact same version should be used together.
With this change all org.eclipse.aether* packages are now imported with a strict version range of
'org.eclipse.aether*;version="[@version,@version]"'
Fixes https://issues.apache.org/jira/browse/MRESOLVER-571
This PR currently also containes the changes planned for https://github.com/apache/maven-resolver/pull/505.
If there is agreement for this change, I'll forward port it to the master/2.x.

Turned it into a draft for now since it contains the changes for https://github.com/apache/maven-resolver/pull/505. Just to ensure it is not accidentally submitted with that.

@HannesWell can you double check the merge ?

@HannesWell can you double check the merge ?

I double checked the merge, respectively rebased this branch on top of the current maven-resolver-1.9.x branch.
Then I checked the result of the combined Manifest changes applied recently and all looks as expected, except for the application of the -noimport directive done in this PR. As stated in BND doc for the Export-Package header that directive has to be applied "on the export instruction". I fixed that for this PR already and provide a follow-up on https://github.com/apache/maven-resolver/pull/520 for the master branch.
For me this is now ready. Thanks for all of your reviews.


UI/UX updates

Hi,
Is there an opportunity i can jump in and assist in updating the UI for a bit of a more polished experience.
It currently is very functional but looks like the css didnt load :P
BTW. Great work so far. Working very nicely

Sure! You are more than welcome!


Publish compiled wheels for Windows

Thanks for publishing precompiled wheels for Linux and MacOS. Would it be possible to publish wheels for Windows as well?
Thanks!

Since we understand Windows is an important OS for NGT, we are considering that.  So far, we have no plan for that.

Thank you for the update!

fwiw, I tried compiling NGT on Windows with GitHub Actions. I'm not very good at C++, but wanted to report my findings for others.
The following errors occurred:

error C3646: '_mutex': unknown override specifier
error C4430: missing type specifier - int assumed. Note: C++ does not support default-int
fatal error C1083: Cannot open include file: 'sys/time.h'
fatal error C1083: Cannot open include file: 'unistd.h'
fatal error C1083: Cannot open include file: 'pthread.h'

From what I can tell, 1 and 2 are likely smaller changes that will be compatible with Unix.
For 3, 4, and 5, there are some suggested approaches on Stack Overflow.

sys/time.h
unistd.h
pthread.h

Overall, I imagine this would take some time.
Build code: https://github.com/ankane/ml-builds/blob/ngt-windows/.github/workflows/ngt-windows.yml
Full output: https://github.com/ankane/ml-builds/runs/429047982
(had to set -D UNIX=ON for it to build the library)

Windows support would be great! I'm trying to use NGT on a client-side app, so lacking Windows support is really a bummer.


Abacus Report is unable to gather the report for (end-of-month - 1) millisecond

When using the link http://abacus-usage-reporting.xxx/v1/metering/organizations/:org-id/aggregated/usage/:time
We use this link to grab the usage from the end of the month. We take the time of the month the deduct one millisecond from it to get the report for that month. We submitted reports were processed on Date Tue, 03 Nov 2015 00:53:45 GMT. We tried to grab the report using:
http://abacus-usage-reporting.xxx/v1/metering/organizations/org-id/aggregated/usage/1448927999999

However, this will give us the issue
{
  "error": "Forbidden by design doc validate_doc_update function"
}

We were able to resolve this by decreasing the time ANOTHER millisecond so the query looked like this:
http://abacus-usage-reporting.xxx/v1/metering/organizations/org-id/aggregated/usage/1448927999998

The error message returned is when PouchDB gives from an error in the validate_doc_update function, I believe. Does your database have any design documents? These could be failing validation. Although in the case of the report, no document should be written back to the db, which is the strange part.
I've tried running my own tests. I ran a simple test of running the demo and querying for that organization using the timestamp of<PHONE_NUMBER>999, but it was able to return. I've tried both with the in-memory database and a local installation of couchdb. With the local couchdb installation, I put a design document with a validate_doc_update function that always throws an error after running the demo(so nothing else can be written to the db), but in both cases, they were able to return with the (end-of-month -1) millisecond timestamp.
Do you by chance have any logs of perhaps the dbclient/dbserver or more details on what you ran when this behavior popped up?

After revisiting this, this does pop up in the case of using an api key rather than the account credentials to access a cloudant db.
In the report, the t passed by the user to the query is incremented by 1. This was to catch the case in which the user knows the exact time of the submission and queries based on that time. This would return that latest submission. The issue with the +1 is that it can go onto the next month.
The better idea is to append highest-sorted character in the collation sequence for strings. In the case of couchdb, that would be 'Z' as specified here:
http://wiki.apache.org/couchdb/View_collation#Collation_Specification


App bright white flashing and flickering while scrolling

Operating System:

[ ] Windows
[ ] Linux/Ubutnu
[x] macOS Sierra

Clear steps to reproduce the issue:
While scrolling through messages in a stream topic, there's recurrent bright white flashes in a flickering streak across the screen. This does not happen while using Zulip in a browser.
The app is also using a significant amount of CPU usage while open.
Relevant error messages and/or screenshots:

@eligang can attach a screenshot/gif here?

Interesting. Never seen this kind of bug, let me try to reproduce this.

@eligang, @warsaw I can't reproduce this.

Can you folks reproduce this issue on https://chat.zulip.org/ server?

Howdy @warsaw!  Can you check whether you get the same issue if you do the same scrolling in the Zulip webapp in Chrome?  That'd be helpful for isolating whether it's a webapp or Electron bug.

@timabbott Hi!  I cannot reproduce this with the Zulip webapp in Chrome in night mode.  Only the macOS desktop client in night mode AFAICT.

Good to know.  This feels like a browser bug (basically in upstream electron).  @akashnimare I think the next thing to try is to download the version of Chromium that Electron is on and reproduce that there?

@timabbott I actually am having some flashy blips in the regular non-night mode of the Zulip Electron app (yes, the 1.9.0 release) on Mac as well, but not nearly as bad or frequently consistent flickering as shown in night mode.

I think this might be a caching issue. Can you folks clear the application data using the following option from setting page -

I don't really see a story for how this would be a caching issue.  But I guess it's pretty hard to come up with a good theory for why this is happening that isn't something weird:

It doesn't reproduce with Chrome for the same users
It doesn't reproduce for other users with the desktop app.

Resetting the app data does not fix the problem for me, although as I'm watching it now, the flashing is more apparent when scrolling quickly.

Here is my observation (macOS 10.13.2 High Sierra)

Works as expected in night mode and normal mode (chat.zulip.org server).
Same result on python's Zulip server.

@warsaw let me update to macOS 10.13.4 and check if I can reproduce this.

Updated to macOS 10.13.5 Beta but no luck reproducing the issue.
This might be related - https://bugs.chromium.org/p/chromium/issues/detail?id=470669

This does sound like a similar problem, but is it related when using the Zulip desktop app in Mac OS? I don't tend to have this issue while using the web app in Chrome (or Safari), so it seems to be specifically something with the macOS app- and I'm only on 10.12.6 Sierra.

The macOS version for download is still 1.9.0 and there doesn't seem to be a menu option to download and install a new version.

@akashnimare maybe worth opening a separate issue for adding a "check for updates" option on the screen showing the version?  I think that would be a good idea for this sort of test-a-new-release situation.

Yeah, I had thought to do so but somehow missed it. Generally, desktop app adds this option in the file menu item -

I've updated to the 2.0.0 version and no change- still the bright white flashing. I am also on an internal Zulip server instance at our org.
I recall this being the case before the 18.0 app version as well, but it either became worse/ more frequent or just more obviously headache-inducing apparent with the night mode setting, which would otherwise be my preferred view. But it also does happen in the regular non-night mode too.

Experienced this issue again today on 2.0 on both CZO and a self hosted instance (both running the 1.8.1-rc) it was on both white and dark themes, but reset itself when I changed apps to start a screen capture. FYI, changing apps does seem to reset it frequently. Hard to capture.

@shidarin okay, I'll be releasing a new beta release tomorrow which uses the updated chromium version and I'm hoping this error will be sorted after that.

Yeah, this certainly feels like a browser bug.

A new beta v2.2.0-beta has been released, this contains and update to the electron version which uses an updated chromium version, which we hope should solve  this issue. So please give  this beta a try. To upgrade to this version, you need to check the Get beta updates option from app settings. Or manually download from  here .

Indeed.  A quick test with 2.2.0-beta appears to have fixed the problem.  I'll keep an eye on it, but so far so good!  Thanks.

@warsaw awesome. @shidarin, @eligang can you folks also confirm if this works for you?

@akashnimare Just updated to the beta version. Yes, this is great- MUCH smoother now when scrolling and the flashing issues seems to be completely resolved (even in night mode)! Thank you :)

@eligang good to know. Feel free to reopen the issue if you see something like this in future!

I've also updated to the beta and have also not hit this issue yet.


Update demo of training dynamics interpreter

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Feature Request - Sanity Checks Idea

Hi,
Would it be possible to have some sanity checks?
Specifically regarding file size, if a user is suffering from log bloat due to an issue on their system or tries to upload a file over a certain size could the user be prompted by pbcli with a message saying "hey you are about to upload a file of X size, please note this may be rejected by the host and/or take a long time to upload are you sure you want to continue? Y/N"
Perhaps have a default allowed file size and include a file size limit flag that could be set in custom configs should pbcli be packaged by a distro?
Love the tool BTW, really appreciate the work.

Greetings,
thank you for creating this issue.
A feature like this is certainly possible, however I would see this as an entirely opt-in feature and not a default setting, meaning not setting anything would result in no warning. Additionally it is not possible (as far as I know) to retrieve the sizeLimit setting from the target privatebin instance, meaning that value is entirely user configured.
Do you have a proposal for the flag name? I was thinking something along the lines of --warn-filesize-limit 5mb.
Best Regards
Mydayyy

Greetings,
thank you for creating this issue.
A feature like this is certainly possible, however I would see this as an entirely opt-in feature and not a default setting, meaning not setting anything would result in no warning. Additionally it is not possible (as far as I know) to retrieve the sizeLimit setting from the target privatebin instance, meaning that value is entirely user configured.
Do you have a proposal for the flag name? I was thinking something along the lines of --warn-filesize-limit 5mb.
Best Regards Mydayyy

Hi,
Thanks for the super quick reply.
Not being able to get the file size limit of the privatebin is fine, should this be packaged by any distro then I would assume that the distro peeps would know what the filesize limit is on their instance and can implement the flag in the config themselves in the package.
I am honoured regarding feedback on the flag itself, personally I tend to keep my aliases thematic and simple, I would assume the warning would present itself should the set limit be reached or exceeded anyway so perhaps --size-limit or --fslimit.
I really appreciate the work that has been put into this.
Thank You.

Greetings,
thank you for getting back to me on that. I believe I will go with --size-limit since in my mind fs usually refers to filesystem and therefore fslimit could be confusing. I will proceed to implement it as an optional parameter defaulting to zero meaning no limit as I mentioned above.
I expect I should find the time somewhere in march to implement that. I would also also upgrade all the dependencies of pbcli since I expect a lot of new versions came out since and I believe clap is out of beta.
Best Regards
Mydayyy

Greetings,
thank you for your patience.
I implemented the feature and published a release candidate for 2.3.0. If you have time and want to test it I would be happy to hear feedback.
Implementation details:  We are checking the size twice. One time before the base64 encode the provided file, in order to prevent uncessecarily encoding a file which would be too large anyways. The second check is done after the data to be sent is assembled (paste text, attachment base64 encoded).
If any of those checks fail the command will ask whether to proceed. If running without an attachment terminal (e.g CICD) the command will simply fail.
Link to rc: https://github.com/Mydayyy/pbcli/releases/tag/v2.3.0-rc.1
Example usages:
pbcli --upload FILENAME --size-limit 1047983
pbcli --upload FILENAME --size-limit 10mb
pbcli --upload FILENAME --size-limit 2GB
pbcli --upload FILENAME --size-limit 1kb
pbcli --upload FILENAME --size-limit 500KB

Hi,
My apologies I have been in the thick of it irl.
I have notified matte_schwartz and the Nobara Project Discord regulars.
I am assuming that like the --host flag the config file will need --size-limit=?

Greetings,
yes that is correct. That flag needs to be passed like all the others. Optionally in can also be put in the config file. The behavior.
Best Regards
Mydayyy

Hi,
Happy to report that I haven't had any issues running the release client as a normal user would i.e. journalctl -b 0 | pbcli --upload /path/to/image.png with a 5MB limit set, matte_schwartz may be a little more in depth with their testing with njust.
I did notice that if you try to upload a file larger than the file size limit you will be prompted regarding it but will be allowed to continue if you press yes, matt_schwartz pointed out that should the file size be larger than the limit set on the privatebin a timeout message is received (I know, privatebin limit isnt your monkeys nor your circus) if the user presses yes to the prompt and the privatebin set as host doesnt have a limit would it be beneficial to prompt the user again with are you sure? should the file being uploaded via pbcli be a couple of GB in size?
Sort of like a if file size > 1GB then double check if the user really wants to upload ... kind of a hard baked in file size = prompt thing sorry I am obviously not a programmer nor have I tried to upload a massive file to test this so it may be in pbcli already.
Love the work and thank you

Greetings,
thanks for your continued patience as well as your feedback on the new version.

matt_schwartz pointed out that should the file size be larger than the limit set on the privatebin a timeout message is received

There might be several factors at play here. For once, any reverse proxy in the chain could be able to reject that request as well as the privatebin instance as the final instance. Privatebin is not really suited for huge files since the decryption inside the browser will fail at some point. Also keep in mind that the size of the file must be well below the limit since it needs to be base64 encoded which blows up the size. If you suspect that pbcli might be at fault here I am happy to look into that tho.

if the user presses yes to the prompt and the privatebin set as host doesnt have a limit would it be beneficial to prompt the user again with are you sure? should the file being uploaded via pbcli be a couple of GB in size?

Unfortunately, we are not able to query the privatebin instance for the configured limit, so we as the client will never know.
Additionally, I do not see the benefit of a second hard baked check, since the user already confirmed it. The second check would need to be disabled inside a CICD pipeline anyways, since otherwise there would be no way to upload bigger files from inside.
If you feel otherwise I am happy to hear more thoughts on that.
In any case, since no regressions were reported, I will promote this release candidate on the weekend and also push the new version to cargo and the AUR (and in turn, close this issue once released)
Best Regards
Mydayyy

Greetings,
PBCLI 2.3.0 has been promoted to a release here as well as released on the aur and crates
Best Regards
Mydayyy


Add ContributingGuidelines.md

The Contributing Guideline documentation will contain set of guidelines that will help contributors during the contribution process.
File type markdown.

@tusharzalte could you please assign this issue to me.
Thank you!

@tusharzalte Could you please assign this issue to me.

Resolved


Good return values for min_time and max_time

When executing the code in Dynamic benchmarks mode (see Example 14), I had weird results for min_time and max_time.
It was because they were divided by _total_operations, like done for avg_time, but shouldn't.
I didn't try the other modes.
Correct me if I'm wrong.

What report did you get?
Mine is the following:
===============================================================================
CppBenchmark report. Version <IP_ADDRESS>
===============================================================================
CPU architecture: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
CPU logical cores: 8
CPU physical cores: 4
CPU clock speed: 3.998 GHz
CPU Hyper-Threading: enabled
RAM total: 31.962 GiB
RAM free: 21.089 GiB
===============================================================================
OS version: Microsoft Windows 8 Enterprise Edition (build 9200), 64-bit
OS bits: 64-bit
Process bits: 64-bit
Process configuration: release
Local timestamp: Tue Oct  6 17:50:48 2020
UTC timestamp: Tue Oct  6 14:50:48 2020
===============================================================================
Benchmark: Initialization
Attempts: 1
Duration: 5 seconds
-------------------------------------------------------------------------------
Phase: Initialization
Total time: 2.001 s
===============================================================================
Benchmark: Calculate
Attempts: 1
Duration: 5 seconds
-------------------------------------------------------------------------------
Phase: Calculate
Total time: 2.206 s
-------------------------------------------------------------------------------
Phase: Calculate.1
Average time: 100.731 ms/op
Minimal time: 20.020 ms/op
Maximal time: 20.195 ms/op
Total time: 503.657 ms
Total operations: 5
Operations throughput: 9 ops/s
-------------------------------------------------------------------------------
Phase: Calculate.2
Total time: 501.457 ms
-------------------------------------------------------------------------------
Phase: Calculate.2.1
Total time: 200.715 ms
-------------------------------------------------------------------------------
Phase: Calculate.2.2
Total time: 300.709 ms
-------------------------------------------------------------------------------
Phase: Calculate.3
Average time: 400.567 ms/op
Minimal time: 133.495 ms/op
Maximal time: 133.556 ms/op
Total time: 1.201 s
Total operations: 3
Operations throughput: 2 ops/s
===============================================================================
Benchmark: Cleanup
Attempts: 1
Duration: 5 seconds
-------------------------------------------------------------------------------
Phase: Cleanup
Total time: 1.000 s
===============================================================================

For something similar to your Phase 3, I was getting microseconds for the min and max time, and milliseconds for average time.
In fact, it is the case in what you pasted here too:
Phase: Calculate.3                                                              Average time: 400.567 ms/op                                        Minimal time: 133.495 ms/op                                               Maximal time: 133.556 ms/op
The maximal time is inferior to the average time (what is impossible)

Aaah now I see. We'll look into it more deeply soon.

Fixed


pull in kitty-items-web

Yeah, ill have another PR shortly for that.

Yeah, ill have another PR shortly for that.


Add configs to TSLint and Prettier for Markdown

Currently, the TSLint and Prettier plugins change the formatting of our markdown files in undesirable ways. We need to add a config to both of these plugins to ignore markdown.

No doc input required.


Analytic naming change

@miankhalid @saeedbashir
Looks like iOS uses lowercase. It pulls the text after "Choose Form Value" from the profiles.json file.
https://github.com/edx/edx-app-ios/blob/master/Source/en.lproj/profiles.json#L19
https://github.com/edx/edx-app-ios/blob/master/Source/en.lproj/profiles.json#L41
iOS is already emitting this event, Android is not. I figured we should change it on Android to match iOS for consistency. Thoughts?

Current coverage is 16.77% (diff: 100%)

Merging #915 into master will not change coverage

@@             master       #915   diff @@
==========================================
  Files           460        460
  Lines         19445      19445
  Methods           0          0
  Messages          0          0
  Branches       2871       2871
==========================================
  Hits           3261       3261
  Misses        15825      15825
  Partials        359        359

Powered by Codecov. Last update a4e9736...8e0845e

@MirzaMubasharBaig FYI.


deploying with now or surge

Seems that deploying with either of these service gets you the following error. FYI
If you download the codebox (demo)[https://codesandbox.io/s/p5n69p23x0] and run it, it works without changing anything when running on dev local. When you build it, npm run build, and serve with serve -s build, or deploy it with now or surge, you get the issue noted below.
Error: Cannot use e "__Schema" from another module or realm.

Ensure that there is only one instance of "graphql" in the node_modules
directory. If different versions of "graphql" are the dependencies of other
relied on modules, use "resolutions" to ensure only one version is installed.

https://yarnpkg.com/en/docs/selective-version-resolutions

Duplicate "graphql" modules cannot be used at the same time since different
versions may have different capabilities and behavior. The data from one
version used in the function from another could produce confusing and
spurious results.

related? https://github.com/gajus/babel-plugin-graphql-tag/issues/8

How is this handled elsewhere? Should it be a peer?

Looks like peer dependency. https://github.com/apollographql/graphql-tag/blob/384a9b222a67bdcc966ed23a2c43bbbcd26db10d/package.json#L33

Its a peer now in 0.0.10. This should be all set.

This is still a problem, pending a fix on the graphql side


Fix scripts on windows

On windows the dev:mainnet and dev_devnet didn't work.
Because setting environment variables in windows has to be done via set WHATEVER=ddd .
However when I changed it to that it didn't work anymore on my ubuntu :P
So I used the recommended way from webpack to pass in custom arguments.
However I didn't adjust the prod config - wanted to hear what you think of it first.
Btw I recommend reviewing with ignoring whitespaces on this one:
https://github.com/ArkEcosystem/ark-explorer/pull/121/files?w=1

oh didn't know... always did it like that in npm and just assumed it's the same in yarn :) => changed

If you update the prod.conf I will test again and merge it if all works fine.

Phew was harder & more complex that I thought 😅
Hope everythings right now.
I unified the two configs so the arguments for both configs are parse the same way.


ContextMenu onContextMenu should prevent default

In ContextMenuclass rendermethod is an onContextMenu prop, which bind the handleHide method to the navelement.
handleHide hasn't a preventDefault, so when someone tries to open an contextmenu with right click on the contextmenu itself, the browser system contextmenu will show up instead.
I would recommend a simple onContextMenu={e => e.preventDefault()}. With this change the browser system contextmenu won't show up and the react-contextmenu will hide regardless correctly.

My intention behind it was for easier debugging while development, But I agree with your point.
We can add something like:
if (process.env.NODE_ENV === 'production') {
  e.preventDefault();
}

This would be nice.


Unable to set the System Disk size

From my reading of the docs I need to set image_disk_mappings -> disk_size if i want a custom system disk size
"disk_size (number) - Size of the system disk, in GB, values range:"
I'm setting it in packer as follows:
"image_disk_mappings":[{"disk_size":256}],
but this always creates a secondary data disk of 256GB leaving the system disk at 40GB, custom disk sizes work ok from the console.  Is this something I am doing wrong?  How can you set a custom system disk size in packer?

Hi @Marcus-James-Adams , thanks for submitting this issue. image_disk_mapping options is only applied to data disks. We may need another option to support system disk related properties. We'll support this as soon as possible.

Thanks, its a show stopper for me as our systems need bigger system disks.
Is the following workaround possible?  I Manually create my own custom image Base OS disk that's based on a 256GB disk and then if I run packer using that as the source image will the new images have 256GB disks? or will it try and revert to a 40GB?

@Marcus-James-Adams

I Manually create my own custom image Base OS disk that's based on a 256GB disk and then if I run packer using that as the source image will the new images have 256GB disks

Yes, it will do the trick.

This feature has been satisfied by #48


Zod Engine license

http://zod.sourceforge.net/, https://sourceforge.net/projects/zod does not seem to have license information attached to the source code
Contact the author(s) and ask for clarification or possibility to add license information.

I got an answer saying that the default is GPLv3, but if someone wants a different license, they would also be willing to do that.
I will ask if this statement can be included in the code base. Also I will add an entry for the Zod Engine.

The copyright statement was not included, but I can do that for them. I will convert the Hg repository to Git, add the license statement, add an entry for it and inform the author about it. Maybe also the ZZone community.

I'm not sure if the content bundled with the code is correctly licensed. And because of that the authors did not add the copyright notice themselves, I refrain from doing the conversion to Git, adding the License and sorting out the licenses of the content, just to be sure that everything is fine. Will not add an entry. Will close the issue for now. May come back later if there is more time or if something changes (rights get more clear). Maybe will contact the community.


XML Doc it not shown on Quick Info tooltip for symbols defined in mscorlib.dll

Odd - what's your project file reference to mscorlib?  I'm seeing the docs in VisualFSharp.sln

I'm seeing xmldocs on a new library proejct

I cannot reproduce it on current master. Closing.


Fix getViewableWorkspaceBounds()

This change is

Review status: 0 of 1 files reviewed at latest revision, 1 unresolved discussion.

blocklylib-core/src/main/java/com/google/blockly/android/ui/WorkspaceHelper.java, line 521 at r1 (raw file):

    /**
     * Gets the visible bounds of the workspace, in workspace units.

Comment still saying "in workspace units" instead of "in virtual workspace units"
I don't understand the coordinate systems anymore, but I think the distinction does matter.

Comments from Reviewable

Review status: 0 of 1 files reviewed at latest revision, 1 unresolved discussion.

blocklylib-core/src/main/java/com/google/blockly/android/ui/WorkspaceHelper.java, line 521 at r1 (raw file):
Previously, rachel-fenichel (Rachel Fenichel) wrote…
Comment still saying "in workspace units" instead of "in virtual workspace units"
I don't understand the coordinate systems anymore, but I think the distinction does matter.

This is workspace units, as I understand them. This is the same coordinate system as the positions of blocks and connections.

Comments from Reviewable

Review status: 0 of 1 files reviewed at latest revision, 1 unresolved discussion.

Comments from Reviewable


Video intro to using Carbon Sketch components

I'm quite new to Sketch - and I was able to make a few views in a day, so it wasn't bad, but I'm not sure I'm using it correctly. This may not be for everyone - but a 20 minute, no nonsense screencast overview of creating an app view with the Carbon template would be great.
For instance - I just copy and paste with it - is there a more integrated way of using the components on an artboard?
What's a typical flow? No more than 20 minutes - no personal intro, no system background - just looking over the shoulder of a designer making something with the sketch components.

This is really good to hear. We've had other ideas for videos that were more dev focused but having intro content like this for designers using sketch sounds good too.

Can definitely help out with this if needed 😄  I've done a lot of screencasts over for Egghead.io (example)

Issue moved to carbon-design-system/carbon-design-kit #15 via ZenHub


Metadata parsing fails for Markdown document

For the following, entirely well-formed Markdown document, metalsmith throws an error during metadata parsing. Note that the document does not contain any metadata, but it is currently not possible to exclude specific documents from metadata parsing.
Who
---

`foo`

What
----

Seems like a bug that should be solved upstream in the frontmatter parsing dependency.

Fixed in 1.4.x!


Receiving a "formatters" key error

Hi, I'm trying to run tile2net on windows. It seems that there is an issue with AttrDict and Namespace imports.
The import produces an error
`from tile2net.namespace import AttrDict, Namespace
Traceback (most recent call last):
  Cell In[4], line 1
    from tile2net.namespace import AttrDict, Namespace
File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\tile2net_init_.py:13
    from tile2net.raster.raster import Raster
File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\tile2net\raster\raster.py:41
    from tile2net.logger import logger
File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\tile2net\logger.py:9
    pipe(
File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\toolz\functoolz.py:628 in pipe
    data = func(data)
File ~\AppData\Local\Programs\Python\Python310\lib\logging\config.py:72 in fileConfig
    formatters = _create_formatters(cp)
File ~\AppData\Local\Programs\Python\Python310\lib\logging\config.py:105 in _create_formatters
    flist = cp["formatters"]["keys"]
File ~\AppData\Local\Programs\Python\Python310\lib\configparser.py:965 in getitem
    raise KeyError(key)
KeyError: 'formatters'`
After some debugging, it's coming from an inner call for import in config.py : from tile2net.tileseg.utils.attr_dict import AttrDict
Any idea where is this coming from or how to resolve?
I Installed all requirements
Thank you.

Thank you for raising this issue. This issue has been resolved. Please reinstall the latest version of tile2net. Originally we had the user install with the flag -e to circumvent this problem but that is no longer necessary.


QnAMaker dialog: Load from file UI confusion

Issue
UI suggests that I can load from a local file but entrybox suggests entering a URL and no way to invoke local file selection (i.e. in windows file explorer). At this stage, user is left with "how do I load my local file?"
Visual

Version:
Version:  2.0.0-nightly.258070.287a4dc
Electron: 8.2.4
Chrome: 80.0.3987.165
NodeJS: 12.13.0
V8: 8.0.426.27-electron.0

@scheyal  we are updating the copy here now.

Recommended text:
Text in radio selection: "Create new knowledge base from URL"
Text in description: "Select this option if you want to create a knowledge base from content hosted online such as an FAQ or document link (.csv, .xls or .doc format)"
@srinaath @boydc2014 @zhixzhan


Keras 3.0: ops.slice_update doesn't work with pytorch backend

NotImplementedError: Could not run 'aten::_local_scalar_dense' with arguments from the 'Meta' backend. This could be because the operator doesn't exist for this backend, or was omitted during the selective/custom build process (if using custom build). If you are a Facebook employee using PyTorch on mobile, please visit https://fburl.com/ptmfixes for possible resolutions. 'aten::_local_scalar_dense' is only available for these backends: [CPU, MPS, BackendSelect, Python, FuncTorchDynamicLayerBackMode, Functionalize, Named, Conjugate, Negative, ZeroTensor, ADInplaceOrView, AutogradOther, AutogradCPU, AutogradCUDA, AutogradHIP, AutogradXLA, AutogradMPS, AutogradIPU, AutogradXPU, AutogradHPU, AutogradVE, AutogradLazy, AutogradMTIA, AutogradPrivateUse1, AutogradPrivateUse2, AutogradPrivateUse3, AutogradMeta, AutogradNestedTensor, Tracer, AutocastCPU, AutocastCUDA, FuncTorchBatched, FuncTorchVmapMode, Batched, VmapMode, FuncTorchGradWrapper, PythonTLSSnapshot, FuncTorchDynamicLayerFrontMode, PreDispatch, PythonDispatcher].

Hi,
By the error message details it is a NotImplementedError and has to be supported by PyTorch.
Please create file an issue in torch repo.


webapi v2 documentation

For webapi v2 in the latest admin_guide( app/assets/pdf/admin_guide.pdf ) there is no documentation.
Please update it.
Thanks.

Finally we have the documentation.
Please find the download link here, https://drive.google.com/open?id=0B8TPidn4fW-2ZlZ2bmFCbVdEblFncVhXVUZrVWt0ZjJ6R0RZ.
@joffems, please include it in admin_guide.


[MB-8999] Include reweigh in move weight total on MTO page if lower than shipment actual weight

Description
Now that shipment's can have reweigh weights, we want to take that into account when showing the total move weight of all shipments on the MTO page.  The reweigh weight will be used instead of the actual weight when it is lower than the actual weight of that shipment.  We also want to ignore any shipments that aren't on the MTO page so we want to ignore shipments in the status of DRAFT, SUBMITTED, and CANCELLED.  While CANCELLED will still appear on the MTO page because it was previously approved, it's weights won't contribute to the total move weight.
Reviewer Notes
We had a discussion during sprint planning and came to the conclusion we didn't have clarity on what to do with diversions that result in 2 shipments in the system.
Setup
Add any steps or code to run in this section to help others prepare to run your code:
make db_dev_e2e_populate
make server_run
make office_client_run

Code Review Verification Steps

[ ] If the change is risky, it has been tested in experimental before merging.
[ ] Code follows the guidelines for Logging
[ ] The requirements listed in Querying the Database Safely have been satisfied.
Any new migrations/schema changes:

[ ] Follow our guidelines for zero-downtime deploys (see Zero-Downtime Deploys)
[ ] Have been communicated to #g-database
[ ] Secure migrations have been tested following the instructions in our docs

[ ] There are no aXe warnings for UI.
[ ] This works in Supported Browsers and their phone views (Chrome, Firefox, IE, Edge).
[ ] Tested in the Experimental environment (for changes to containers, app startup, or connection to data stores)
[ ] User facing changes have been reviewed by design.
[ ] Request review from a member of a different team.
[ ] Have the Jira acceptance criteria been met for this change?

References

Jira story for this change

Screenshots

Messages

:book:
:link: MB-8999

  Generated by :no_entry_sign: dangerJS against c0c208d351509516e6d5d9abedfe4ff423db738a


Is this code run in linux ? share linux support code ?

Is this code run in linux ? share linux support code ?

I have not tested it on Linux but it should compile - someone submitted a patch for the Linux build

I check it when I get a chance - are you looking for a specific Linux install package ?

It builds for me on linux, and runs, and generates a file that looks like a valid STEP file, but neither FreeCAD nor KiCAD can display the file. They load the file, but show nothing.
(in KiCAD I'm only talking about the footprint editor where you can load a step file model of an electronic component to go with the pcb footprint)
To build & install on linux I used the following commands

cmake .
make
sudo make install

Here are 2 step files generated from the same stl. One by FreeCAD one by stltostp
sample_compare.zip

not working with the Open Cascade (Free CAD and KiCAD?) is a known issue. Thanks for the example files. I installed Free CAD and will work on the issue.

Same issue here.

Do we know why loading to FreeCAD of step file produce with this tool fails? Any one dig in to that at all?

Works well with Fusion 360 so far. Have used models with up to 100K Triangles with no issues.  Compiled cleanly on gcc version 11.3.0 (Ubuntu 11.3.0-1ubuntu1~22.04)

Since FreeCAD 1.0, (recently released) STEP export from FreeCAD are invisible in KiCad.
It seems from what little I can gather from developer comments in the FreeCad forum site, that there has always been some bug with how both apps, or maybe the underlying open cascade engine they both use, interprets some transparency bits.
FreeCAD claims they fixed it and are now doing it right, and so that's why the step files exported from freecad look fine when loaded back into freecad, but are now invisible in kicad, when they used to both be visible to each other.
I haven't tried, but I wouldn't be suprised if files generated by stltostp are now visible in freecad 1.0 and not earlier versions. IE, it was a freecad bug all along.


tflite support for Softplus (exp and log are already supported)

System information

gLinux
TensorFlow installed from source
TensorFlow version head

Provide the text output from tflite_convert
Some of the operators in the model are not supported by the standard TensorFlow Lite runtime. If those are native TensorFlow operators, you might be able to use the extended runtime by passing --enable_select_tf_ops, or by setting target_ops=TFLITE_BUILTINS,SELECT_TF_OPS when calling tf.lite.TFLiteConverter(). Otherwise, if you have a custom implementation for them you can disable this error with --allow_custom_ops, or by setting allow_custom_ops=True when calling tf.lite.TFLiteConverter(). Here is a list of builtin operators you are using: ADD, CONCATENATION, CONV_2D, MAX_POOL_2D, MEAN, MIRROR_PAD, MUL, RSQRT, SQUARED_DIFFERENCE, SUB, TRANSPOSE_CONV. Here is a list of operators for which you will need custom implementations: Softplus.

We already support log and exp. Softplus seems like a simple addition.

@jdduke , what is your take on this, should we have this operator support in the tflite kernel or should we transform the operator into log and exp using transform graph ?
Regards
Amit

Beware. It will be problematic SoftPlus is simply transformed to log(exp(x) + 1).  There will be numerical stability issues when input is too large or too small.
If going the transformation route, we need to do something like this:
https://github.com/tensorflow/tensorflow/blob/ee82131dbccd4e99decb8c05c43bc2bb387ad6ac/tensorflow/core/kernels/softplus_op.h#L50

@miaout17,thanks for the heads up, highly appreciated your valuable input, will study this deeply and raise a PR in coming days
Regards
Amit

@miaout17 , i have raised the PR, kindly have a look.
Regards
Amit

@jackshi0912,
Sorry for the delayed response. With respect to jdduke's comment in this PR,

Until we find another model which requires this op, I'd rather we rely on using the select TF ops, or we add this as a custom op that users can optionally link into their app.

It's more than 2 years since this feature has been requested and there has been no Model which requires this Op. Do you still think this feature is still relevant? Thanks!


Repeated Deprecation Error

I am repeatedly getting this error when I try to run the pairwise annotator. How do I fix this? The problem seems to be from Alpaca Eval.
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai.com/v1/completions "HTTP/1.1 404 Not Found"
WARNING:root:OpenAIError: Error code: 404 - {'error': {'message': 'The model text-davinci-003 has been deprecated, learn more here: https://platform.openai.com/docs/deprecations', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}.
WARNING:root:Unknown error.
It's likely a rate limit so we are retrying...
Here is the full traceback:
Traceback (most recent call last):
File "/alpaca_farm/test_autoannotations.py", line 19, in
annotated = annotator.annotate_pairs(outputs_pairs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/pairwise_evaluator.py", line 263, in annotate_pairs
return self.call(to_annotate, **decoding_kwargs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/base.py", line 188, in call
df_annotated = self._annotate(curr_df_to_annotate, **decoding_kwargs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/base.py", line 295, in _annotate
curr_annotated = self.annotators[annotator](
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/annotators/base.py", line 665, in call
completions = self.fn_completions(prompts=prompts, **self.completions_kwargs, **decoding_kwargs)
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/alpaca_eval/decoders/openai.py", line 152, in openai_completions
completions = list(
File "/anaconda3/envs/llm-pref/lib/python3.10/site-packages/tqdm/std.py", line 1181, in iter
for obj in iterable:
File "/anaconda3/envs/llm-pref/lib/python3.10/multiprocessing/pool.py", line 861, in next
self._cond.wait(timeout)
File "/anaconda3/envs/llm-pref/lib/python3.10/threading.py", line 320, in wait
waiter.acquire()
KeyboardInterrupt

Thanks for raising that issue @syleedandekar. Unfortunately, there's not much we can do about it given that OpenAI removed davinci-003. To keep the codebase usable I'll switch the annotators to the default AlpacaEval, the numbers won't be exactly comparable to the ones in the paper unfortunately. In particular, it will use a single annotator rather than a batch of annotators.
I'll do that before the end of the week-end. Until then you can probably change this line https://github.com/tatsu-lab/alpaca_farm/blob/b17d605a360fc2936cbe6ee89e81d7270b440903/src/alpaca_farm/auto_annotations/eval.py#L163C13-L163C98 to be "greedy_gpt4".

I think the "greedy_gpt4" model is also deprecated

If you change this line https://github.com/tatsu-lab/alpaca_farm/blob/b17d605a360fc2936cbe6ee89e81d7270b440903/src/alpaca_farm/auto_annotations/annotators/greedy_gpt4/configs.yaml#L9C5-L9C29 to "gpt-4" it should work. I'll do a full fix before the end of the week, namely using the default AlpacaEval.


TechLab mma8452 accelerometer not being installed.

Describe the bug
No such file or directory: '/sys/bus/i2c/drivers/mma8452/2-001c/iio:device1/in_accel_x_raw'
**Describe which image you are running (example: bone-debian-10.2-iot-armhf-2020-02-03-4gb.img.xz) **
BeagleBoard.org Debian Buster IoT Image 2020-07-06
Describe your hardware
PocketBeagle with TechLab board
Please run this built-in script
sudo /opt/scripts/tools/version.sh
sudo: unable to resolve host pocket: No address associated with hostname
git:/opt/scripts/:[029041f6866049997bbfd2c7667b3c6e8c95201c]
eeprom:[A335PBGL00A21750EPB00481]
model:[TI_AM335x_PocketBeagle]
dogtag:[BeagleBoard.org Debian Buster IoT Image 2020-07-06]
bootloader:[microSD]:[/dev/mmcblk0]:[U-Boot 2019.04-00002-g31a8ae0206]:[location: dd MBR]
UBOOT: Booted Device-Tree:[am335x-pocketbeagle.dts]
UBOOT: Loaded Overlay:[BB-ADC-00A0]
kernel:[5.4.47-ti-r12]
nodejs:[v10.21.0]
/boot/uEnv.txt Settings:
uboot_overlay_options:[enable_uboot_overlays=1]
uboot_overlay_options:[disable_uboot_overlay_video=1]
uboot_overlay_options:[enable_uboot_cape_universal=1]
pkg check: to individually upgrade run: [sudo apt install --only-upgrade ]
pkg:[bb-cape-overlays]:[4.14.20200709.0-0~buster+20200709]
pkg:[bb-wl18xx-firmware]:[1.20200702.0-0~buster+20200702]
pkg:[kmod]:[26-1]
pkg:[librobotcontrol]:[1.0.4-git20190227.1-0rcnee0~buster+20190327]
pkg:[firmware-ti-connectivity]:[20190717-2rcnee1~buster+20200305]
groups:[debian : debian adm kmem dialout cdrom floppy audio dip video plugdev users systemd-journal input bluetooth netdev i2c gpio admin spi iio docker tisdk weston-launch xenomai cloud9ide pwm eqep remoteproc]
cmdline:[console=ttyO0,115200n8 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M net.ifnames=0 lpj=1990656 rng_core.default_quality=100 quiet]
dmesg | grep remote
[    2.015444] remoteproc remoteproc0: wkup_m3 is available
[    2.202051] remoteproc remoteproc0: powering up wkup_m3
[    2.202700] remoteproc remoteproc0: Booting fw image am335x-pm-firmware.elf, size 217168
[    2.204511] remoteproc remoteproc0: remote processor wkup_m3 is now up
dmesg | grep pru
dmesg | grep pinctrl-single
[    1.721117] pinctrl-single 44e10800.pinmux: 142 pins, size 568
dmesg | grep gpio-of-helper
[    1.730966] gpio-of-helper ocp:cape-universal: ready
lsusb
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
END
To Reproduce
Steps to reproduce the behavior:

cd /var/lib/cloud9/PocketBeagle/TechLab
./accelerometer.py
Traceback (most recent call last):
File "./accelerometer.py", line 11, in
fdx = open(path + '/in_accel_x_raw', 'r')
FileNotFoundError: [Errno 2] No such file or directory: '/sys/bus/i2c/drivers/mma8452/2-001c/iio:device1/in_accel_x_raw'

UBOOT: Booted Device-Tree:[am335x-pocketbeagle.dts]
UBOOT: Loaded Overlay:[BB-ADC-00A0]

Missing overlay?

Looks like it, but I copied BBORG_TECHLAB-00A2.dtbo from a working version and put it in /lib/firmware and got the same results.  Is it not detecting the TechLAB?
git:/opt/scripts/:[029041f6866049997bbfd2c7667b3c6e8c95201c]
eeprom:[A335PBGL00A21750EPB00481]
model:[TI_AM335x_PocketBeagle]
dogtag:[BeagleBoard.org Debian Buster IoT Image 2020-07-06]
bootloader:[microSD]:[/dev/mmcblk0]:[U-Boot 2019.04-00002-g31a8ae0206]:[location: dd MBR]
UBOOT: Booted Device-Tree:[am335x-pocketbeagle.dts]
UBOOT: Loaded Overlay:[BB-ADC-00A0]
kernel:[5.4.47-ti-r12]
nodejs:[v10.21.0]
/boot/uEnv.txt Settings:
uboot_overlay_options:[enable_uboot_overlays=1]
uboot_overlay_options:[disable_uboot_overlay_video=1]
uboot_overlay_options:[enable_uboot_cape_universal=1]
pkg check: to individually upgrade run: [sudo apt install --only-upgrade ]
pkg:[bb-cape-overlays]:[4.14.20200709.0-0~buster+20200709]
pkg:[bb-wl18xx-firmware]:[1.20200702.0-0~buster+20200702]
pkg:[kmod]:[26-1]
pkg:[librobotcontrol]:[1.0.4-git20190227.1-0rcnee0~buster+20190327]
pkg:[firmware-ti-connectivity]:[20190717-2rcnee1~buster+20200305]
groups:[debian : debian adm kmem dialout cdrom floppy audio dip video plugdev users systemd-journal input bluetooth netdev i2c gpio admin spi iio docker tisdk weston-launch xenomai cloud9ide pwm eqep remoteproc]
cmdline:[console=ttyO0,115200n8 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M net.ifnames=0 lpj=1990656 rng_core.default_quality=100 quiet]
dmesg | grep remote
[    2.015245] remoteproc remoteproc0: wkup_m3 is available
[    2.201977] remoteproc remoteproc0: powering up wkup_m3
[    2.202632] remoteproc remoteproc0: Booting fw image am335x-pm-firmware.elf, size 217168
[    2.204430] remoteproc remoteproc0: remote processor wkup_m3 is now up
dmesg | grep pru
dmesg | grep pinctrl-single
[    1.719426] pinctrl-single 44e10800.pinmux: 142 pins, size 568
dmesg | grep gpio-of-helper
[    1.729401] gpio-of-helper ocp:cape-universal: ready
lsusb
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
END

eeprom is used yet, you need to specifiy the overlay for techlab..

Can we change this issue to add EEPROM support for PocketBeagle overlays?

Looks like the same thing for /sys/class/leds/techlab::seg.
@RobertCNelson this was working before.  What's changed?

@MarkAYoder what permissions does it have?

@RobertCNelson  /sys/class/leds/techlab::seg doesn't even show up.
sudo: unable to resolve host ece434: No address associated with hostname
[sudo] password for debian:
git:/opt/scripts/:[7cdc270818b76d829d247cf05fe309c320a3929a]
eeprom:[A335PBGL00A21750EPB00481]
model:[TI_AM335x_PocketBeagle]
dogtag:[BeagleBoard.org Debian Buster IoT Image 2020-08-04]
bootloader:[microSD]:[/dev/mmcblk0]:[U-Boot 2019.04-00002-g23f263cc3f]:[location: dd MBR]
UBOOT: Booted Device-Tree:[am335x-pocketbeagle.dts]
UBOOT: Loaded Overlay:[AM335X-PRU-RPROC-4-19-TI-00A0]
UBOOT: Loaded Overlay:[BB-ADC-00A0]
kernel:[4.19.94-ti-r45]
nodejs:[v10.21.0]
/boot/uEnv.txt Settings:
uboot_overlay_options:[enable_uboot_overlays=1]
uboot_overlay_options:[disable_uboot_overlay_video=1]
uboot_overlay_options:[uboot_overlay_pru=/lib/firmware/AM335X-PRU-RPROC-4-19-TI-00A0.dtbo]
uboot_overlay_options:[enable_uboot_cape_universal=1]
pkg check: to individually upgrade run: [sudo apt install --only-upgrade <pkg>]
pkg:[bb-cape-overlays]:[4.14.20200722.0-0~buster+20200722]
pkg:[bb-wl18xx-firmware]:[1.20200702.0-0~buster+20200702]
pkg:[kmod]:[26-1]
pkg:[librobotcontrol]:[1.0.5-git20200715.0-0~buster+20200716]
pkg:[firmware-ti-connectivity]:[20190717-2rcnee1~buster+20200305]
groups:[debian : debian adm kmem dialout cdrom floppy audio dip video plugdev users systemd-journal input bluetooth netdev i2c gpio admin spi iio docker tisdk weston-launch xenomai cloud9ide pwm eqep remoteproc]
cmdline:[console=ttyO0,115200n8 root=/dev/mmcblk0p1 ro rootfstype=ext4 rootwait coherent_pool=1M net.ifnames=0 lpj=1990656 rng_core.default_quality=100 quiet]
dmesg | grep remote
[   53.028962] remoteproc remoteproc0: wkup_m3 is available
[   53.213309] remoteproc remoteproc0: powering up wkup_m3
[   53.213341] remoteproc remoteproc0: Booting fw image am335x-pm-firmware.elf, size 217168
[   53.213622] remoteproc remoteproc0: remote processor wkup_m3 is now up
[   54.804469] remoteproc remoteproc1: 4a334000.pru is available
[   54.806806] remoteproc remoteproc2: 4a338000.pru is available
[  155.554940] remoteproc remoteproc1: powering up 4a334000.pru
[  155.564086] remoteproc remoteproc1: Booting fw image am335x-pru0-fw, size 34012
[  155.564143] remoteproc remoteproc1: remote processor 4a334000.pru is now up
[  419.051594] remoteproc remoteproc1: stopped remote processor 4a334000.pru
[  421.111787] remoteproc remoteproc1: powering up 4a334000.pru
[  421.112092] remoteproc remoteproc1: Booting fw image am335x-pru0-fw, size 34012
[  421.112137] remoteproc remoteproc1: remote processor 4a334000.pru is now up
[  570.085594] remoteproc remoteproc2: powering up 4a338000.pru
[  570.086141] remoteproc remoteproc2: Booting fw image am335x-pru1-fw, size 94200
[  570.101391] remoteproc remoteproc2: registered virtio0 (type 7)
[  570.101412] remoteproc remoteproc2: remote processor 4a338000.pru is now up
dmesg | grep pru
[   54.804469] remoteproc remoteproc1: 4a334000.pru is available
[   54.804638] pru-rproc 4a334000.pru: PRU rproc node pru@4a334000 probed successfully
[   54.806806] remoteproc remoteproc2: 4a338000.pru is available
[   54.806983] pru-rproc 4a338000.pru: PRU rproc node pru@4a338000 probed successfully
[  155.554940] remoteproc remoteproc1: powering up 4a334000.pru
[  155.564086] remoteproc remoteproc1: Booting fw image am335x-pru0-fw, size 34012
[  155.564143] remoteproc remoteproc1: remote processor 4a334000.pru is now up
[  419.051594] remoteproc remoteproc1: stopped remote processor 4a334000.pru
[  421.111787] remoteproc remoteproc1: powering up 4a334000.pru
[  421.112092] remoteproc remoteproc1: Booting fw image am335x-pru0-fw, size 34012
[  421.112137] remoteproc remoteproc1: remote processor 4a334000.pru is now up
[  570.085594] remoteproc remoteproc2: powering up 4a338000.pru
[  570.086141] remoteproc remoteproc2: Booting fw image am335x-pru1-fw, size 94200
[  570.086925] pruss 4a300000.pruss: configured system_events[63-0] = 00000000,000c0000
[  570.086940] pruss 4a300000.pruss: configured intr_channels = 0x0000000a host_intr = 0x0000000a
[  570.101412] remoteproc remoteproc2: remote processor 4a338000.pru is now up
[  570.219574] virtio_rpmsg_bus virtio0: creating channel rpmsg-pru addr 0x1e
[  570.310022] rpmsg_pru virtio0.rpmsg-pru.-1.30: new rpmsg_pru device: /dev/rpmsg_pru30
dmesg | grep pinctrl-single
[    0.894370] pinctrl-single 44e10800.pinmux: 142 pins, size 568
dmesg | grep gpio-of-helper
[    0.903370] gpio-of-helper ocp:cape-universal: ready
lsusb
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
END


Give .safetensors metadata in list_models() response

Is your feature request related to a problem? Please describe.
Right now, the ModelInfo object elements returned as part of a call to HfApi.list_models() all have their .safetensors set to None.
Describe the solution you'd like
It would be helpful for this method to return .safetensors metadata for each model
Describe alternatives you've considered
Users can use model_info on each individual model to get the .safetensors metadata, however this requires making $O(n)$ requests instead of just 1 list request.
Additional context
n/A

Hi @boyleconnor, thanks for the feedback. Unfortunately returning all safetensors information for all models at once is also a O(n) operation on the back-end. That's why we prefer not to return it in the API  as it would hide an heavy task to the end user. For your info, this limitation is not plan to change in the near future. cc @Pierrci