[Q] How to sync wandb exam dir when some files is missed

During training, I executed wandb.save(args.config_file), and found that the soft link to the config_file file was saved in the experimental directory of wandb.
I then accidentally deleted config_file and got the following error when running wandb sync wandb/offline-XXX-ID:

So, how to sync wandb exam dir when some files is missed.
Thank you very much!

Hi @chenshen03, wandb.save() symlinks your files into the run directory and wandb sync tries to sync those to the cloud. Can you try removing the reference from your run directory and see if that works?

This approach works, but doesn't really solve my concern because I have a lot of run directories. I was wondering if wandb.save could provide a parameter that would copy the source files instead of sysmlink.

I'm running wandb on a local server and expect that each run directory is self-contained without any dependencies with other files, so I can share them direcly across different machines.

We're moving towards deprecating wandb.save eventually so it's not likely that we'll implement this. Copying the source files yourself is always an option. If you call wandb.save on something inside your ./wandb/run_xyz dir you will obviously avoid the symlink issue.


Add the ability to switch to the wlroots vulkan renderer for use with nouveau/nvk

Description
Currently, Nouveau's OpenGL driver has significant limitations. NVK aims to adopt Zink as its OpenGL driver, offering the potential for Vulkan support would benefit Nouveau/NVK users by eliminating an additional translation layer, streamlining the rendering process.

#1396


[SPARK-47124][R][INFRA] Skip scheduled SparkR on Windows in fork repositories by default

What changes were proposed in this pull request?
This PR proposes to skip scheduled SparkR on Windows in fork repositories by default
Why are the changes needed?
To be consistent with other scheduled jobs. We encourage the contributors to turn this GitHub Actions on by default in forked repositories so we better disable them by default.
Does this PR introduce any user-facing change?
No, dev-only.
How was this patch tested?
Manually. Uses https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idif to be consistent with other scheduled jobs.
Was this patch authored or co-authored using generative AI tooling?
No.

Merged to master.

It seems some kind of GitHub Action outage.

Yeah, I was looking at it too. It shouldn't be related to this commit. I saw such error few times before.

I merged a new commit. It looks like okay from that.


fix(TDI-38958): NPE when the input lead value is empty for tMarketoListOperation SOAP API

What is the current behavior? (You can also link to an open issue here)
https://jira.talendforge.org/browse/TDI-38958
What is the new behavior?
Change String parsing method. As in REST, the error should be returned by the API.
Please check if the PR fulfills these requirements

[X] The commit message follows Talend standard
[X] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features) ?
[ ] The code coverage on new code >75%
[X] The new code does not introduce new technical issues (sonar / eslint)

What kind of change does this PR introduce?

[X] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build / CI related changes
[ ] Other... Please describe:

Does this PR introduce a breaking change?

[ ] Yes
[X] No

If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:

Pull request test result: success :star:

Pull request test result: success :star:


Add Unit Tests using Pytest

Commit 1: Introduced pytest tests
Commit 2: Included installation instructions in the README.
Commit 3: Refactor: Consolidated all tests into a single file for improved organization and maintainability.


fix for issue #19 (kcas being built even with stock ocaml)

The lockfree and kcas packages will only be built when the BENCH_TARGET is multibench.
This fixes the confusing error that KC saw in issue #19.

Thanks!


Exposed GraphQL types

Do you consider possibility to generate pure types on GraphQL language?

With pleasure add anu usefull pure types.
Existed types: https://github.com/nodkz/graphql-compose/tree/master/src/type
missingType and missingTypeResolver will be removed, they are rudiments from first version.
Grapql-compose has build-in type constructor with following types: https://github.com/nodkz/graphql-compose/blob/master/src/typeMapper.js#L112-L118
// creation of OutputObjectType
const LonLatTC = TypeComposer.create(`
 type LonLat {
   lat: Float
   lon: Float
 }
`);

// creation of InputObjectType
const LonLatITC = TypeComposer.create(`
 input LonLatInput {
   lat: Float! // required field
   lon: Float!
 }
`);

// also type converter works on field definition via `create`, `addFields`, `setFields` and others:
const PlaceTC = TypeComposerCreate({
  name: 'Place',
  fields: {
     point: 'LonLat!', // we can use created types via `TypeComposer.create`
     filials: '[LonLat]',
  },
});

PlaceTC.addFields({
 name: 'String!',
 // or
 name: {
    type: 'String!',
    description: 'Place name',
 },
 // or
 name: {
    type: new GraphQLNonNull(GraphQLString),
 }

 // other fields
 commenstConnection: CommentsTC.getResolver('connection'),
 commenstConnection: CommentsTC.get('$connection'), // the same as previous line
});

Can I for example generate pure GraphQL type from Mongoose schema?

Of course
const UserTC = composeWithMongoose(UserModel);
UserTC.getType(); // returns GraphQLObjectType
UserTC.getInputType(); // return GraphQLInputObjectType, eg. for args
UserTC.get('fieldWithNesting').getType(); // get GraphQL type of nestedField
UserTC.get('fieldWithNesting.subNesting').getType(); // get GraphQL type of nested nested type

Cool, thanks

I looked at the code, but it seems like getType() is a js implementation of a type, but I meant GraphQL type language http://graphql.org/learn/schema/

I think that it should do graphql-js.
Open PR to expose printType method.
If this PR will be accepted, you can print type in such way:
import { printType } from 'graphql-js';

const UserTC = composeWithMongoose(UserModel);
printType(UserTC.getType()); // returns type in `GraphQL Schema language` form.

But right now you may use something like this:
const UserTC = composeWithMongoose(UserModel);
UserTC.getFieldNames(); // returns just array of field names

// or write some helper (not tested)
function printType(TC) {
  const fields = TC.getFields();
  Object.keys(fields).forEach((fieldConfig, fieldName) => {
    console.log(fieldName, fieldConfig.type.toString());
  })
}

I'm not so YAGNI like Lee, so you may open PR and add TypeComposer.printType method.
Thanks.

By the way, the same method needs for InputTypeComposer.
After that you may do such things:
UserTC.printType();
UserTC.get('someComplexField.subField').printType();
UserTC.get('$findMany.@filter').printType(); // get resolver `findMany` and print type of `filter` arg

I think that printType() is good enhancement for graphql-compose and easy way to became a contributor 😉

printType method now exposed in<EMAIL_ADDRESS>- method source code.
Now you can print type such way:
import { printType } from 'graphql-js';

const UserTC = composeWithMongoose(UserModel);
printType(UserTC.getType()); // returns type in `GraphQL Schema language` form.
printType(UserTC.get('$findMany.@filter').getType());

@yarax do you want to add printType method to TypeComposer and InputTypeComposer?
For simplifying above code to:
const UserTC = composeWithMongoose(UserModel);
UserTC.printType(); // returns type in `GraphQL Schema language` form.
UserTC.get('$findMany.@filter').printType();

Cool! No, I think now when it's official method there is no need to wrap it over

I think that TypeComposer.printType() should have deep argument. That prints all types (for args and complex types) which used for type in TypeComposer.
Ok, let keep this as is, until get real request for this feature.


Modified FetchInterval to look for consecutive chapters

If a manga has 8 or more chapters, but the 10 most recent chapters aren't consecutive (e.g. using a source that only allows free users to download the 5 most recent chapters and the first 5 chapters), Tachiyomi will average the time between the most recent chapter and the 10th most recent available chapter.
This means that if there are missing chapters in-between, the smart update interval could be wildly off. If a manga has 105 chapters, with the most recent chapter on day 1470 (biweekly) but only the first and last 5 chapters are available, Tachi will say that the next chapter releases in ( (1470 - 0) / 10) = 147 days. This change makes Tachi only look at the most recent chapters with consecutive chapter numbers, so in that hypothetical it would expect the next chapter in ((1470 - 1400) / 5) = 14 days.
There's definitely more improvements possible here, this is just a quick hacky change. Ideally it would use more complex math, and currently this change wouldn't work if Tachiyomi can't determine actual chapter numbers (I'm not sure what cases this would happen in).
Other potential improvement: calculate expected next update using the update frequency and the last chapter upload date, rather than the date that the manga was last checked in Tachiyomi.
Before change:

After change:

How does it handle part chapters like 1.1, 1.2 etc.

Going to close this, would be great if this is merged to Mihon instead 👍


Squiggly heredocs linting

Assuming:
Layout/IndentHeredoc:
  EnforcedStyle: squiggly

Actual behavior
Consider the two following equivalent definitions. The difference is that in one case the closing delimiter is aligned with the opening delimiter while the second has indentation zero.
Arguably, the first one is the correct style.
class Squiggly
  def poem
    <<~THE_RAVEN
      Once upon a midnight dreary, while I pondered, weak and weary,
      Over many a quaint and curious volume of forgotten lore—
          While I nodded, nearly napping, suddenly there came a tapping,
      As of some one gently rapping, rapping at my chamber door.
      “’Tis some visitor,” I muttered, “tapping at my chamber door—
                  Only this and nothing more.”
    THE_RAVEN
  end

  def same_poem
    <<~THE_RAVEN
      Once upon a midnight dreary, while I pondered, weak and weary,
      Over many a quaint and curious volume of forgotten lore—
          While I nodded, nearly napping, suddenly there came a tapping,
      As of some one gently rapping, rapping at my chamber door.
      “’Tis some visitor,” I muttered, “tapping at my chamber door—
                  Only this and nothing more.”
THE_RAVEN
  end
end

Squiggly.new.poem == Squiggly.new.same_poem
=> true

but rubocop seems perfectly happy with both styles
$ rubocop -a app/models/squiggly.rb
Inspecting 1 file
Parser::Source::Rewriter is deprecated.
Please update your code to use Parser::Source::TreeRewriter instead
.

1 file inspected, no offenses detected

Expected behavior
Could possibly be to auto-correct the indentation of the closing delimiter in the second method.
RuboCop version
$ rubocop -V
0.52.1 (using Parser <IP_ADDRESS>, running on ruby 2.4.1 x86_64-linux)

Closing as duplicate of #5406. Please follow that issue for updates. 🙂


nonblocking timer library

Please read the Issues section of the Contributing Rules at the "Contributing" link to the right before submitting an issue report.
i would like to have my library included in arduino library manager.
with below link
https://github.com/richardsibanda/nonblockingtimer

I see you found the correct way to submit libraries and have already made a successful submission (https://github.com/arduino/library-registry/pull/3397) so I'll close this as resolved.


commands editor creates commands.pak with increasing size then takes long or fails to re-open

I started to ask about this on discord other night and was going to not report it as a one time thing.
Having a problem with commands.pak for sci_hospitallower.  It hangs the commands editor while loading
and it seems to be related that it's making larger and larger files.  Here's a screenshot of the folder with backups.
For reference the commands.pak at the top is the base size and loads into commands editor no time.
The rest all take minutes. Long as 20-30m with the window displaying not responding.

In the game they all function as intended. Just doing this to commands editor.  It was suggested that a corrupted
AI install might be at fault. I tried the files on the EGS version and same symptoms.
This might be a one time thing only for this map file, but before I go deleting these files I want to make sure
you don't want to examine for any issue that has caused the hang ups and size increase.

I needed to open one of the files that was taking a long time to open and just let it take it's time.
It loaded and I've copied off my settings to a new file.  no problems there but I've saved the "bad" file.

It grew in size again. Doubled to 24.1k.
I'll hold on to this as a sample of whatever this issue is.

Interesting - please could you link the PAK that doubled when you saved?

I had a feeling you might want them.
I put them into a cloud folder. Since the smaller files grew to the larger ones.
Let me know if there are any issues with the link.  It should be a public DL/UL folder:
https://u.pcloud.link/publink/show?code=kZz0pIVZlmAppEx6w8VfbN73il2hy8aBb9wy

I figured out what was causing this, and it should now be fixed in staging. Your broken PAKs will continue to be broken though unfortunately, so you'll have to revert back to before this issue started happening - sorry!

Yeah.  I've already reverted to an older backup and recreated my work.

I seem to have figured out what was causing this issue and fixed one of the broken commands.pak files.
There was a corrupted entry in ayz\levels\sevastopol\science\hospital\maindeck\staff\staff_section
The entry labeled Waits To Morley which is a Terminal Content function.  It had the verbatim text from the T0001 terminal
file shown in the addional_info field:
"Dr. Morley, I don‘t care what you think you need to do. I want you out of San Cristobal NOW.
You know what we‘ve set up in there, and I‘m truly sorry for what it means for the patients who can‘t be moved, but this is the only way.
There will be no further warnings."
I've pasted that here with the white space included. When I used the AI PAK differentiation program it showed the issue
plainly. All that white space was showing as corrupted characters.    This was hanging the listbox preventing my pasting the entry A1_T0001_TEX_2736 in place of the plain text nor was the dropdown window allowing selection it opened and closed right away.  The solution was to remove the additional_info parameter and recreated it then paste in the correct Terminal text data reference.
This seemed to fix at least part of the issue.  The file no longer hangs the commands editor while loading instead taking only moments.  I shall see if I can open the other broken files and make this fix to those too.
I know you said you'd fixed a related bug too, but for information sake I'm adding this here.

I confirmed the fixed on one of those 10kb files.  Took 20m to load, but once it did I made the edit outlined above and the file size deflated from 10k+ to 8.2k.

Hmm, yeah this was the issue I identified with your previous PAK and what I thought I had fixed on staging. Are you using the latest staging and this is still occuring? Did you start with a clean PAK again, or were you using one that was previously edited?

It has recurred if I use the PAK file I have edited over months. I've reverted to PAK files from March and before which
were working before.  It still recurs if I save a few times. Now that I know what is at fault though I can fix it before it
balloons to the point of hanging up the editor.  It's odd it only hangs the editor, not in the game.
I've tried to begin anew with a fresh PAK file, but I have made so many changes I can't recreate some of them
or I lost track of what changes I made.    I have used these older files as templates to create a frash PAK, but there is still
not real way to find all the edits. Even the AI PAK differentiator is not finding everything.   IDK if that is a bug in that
program or something else but it makes tracking the edits via file compare harder.


Redundant code in PrettifyTreeprocessor._prettifyETree

I just saw following code in https://github.com/Python-Markdown/markdown/blob/master/markdown/treeprocessors.py#L398-L412
if self.md.is_block_level(elem.tag) and elem.tag not in ['code', 'pre']:
    ...
    if not elem.tail or not elem.tail.strip():
        elem.tail = i
if not elem.tail or not elem.tail.strip():
    elem.tail = i

In my opinion the two lines in https://github.com/Python-Markdown/markdown/blob/master/markdown/treeprocessors.py#L409-L410
    if not elem.tail or not elem.tail.strip():
        elem.tail = i

are superfluous as they are called regardless identically in https://github.com/Python-Markdown/markdown/blob/master/markdown/treeprocessors.py#L411-L412. Also with the variable i is not changed.
Solution would be to remove the two lines https://github.com/Python-Markdown/markdown/blob/master/markdown/treeprocessors.py#L409-L410

On its way


Removed the rest of the fake nulls

I think I would prefer to get rid of the -987654 altogether. A migration could do it..

I thought I tested that migration, the others all were

👍 just checking 😄


[Feature] - make components in other framwroks also not only html

Is your feature request related to a problem? Please describe.
There is only HTML code integrated with the tailwind.

Describe the solution you'd like
we can add more frameworks and according to that make components. Take an example if the developer selects nextjs it gives a nextjs code component like that.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Hey @nik132-eng,
We already have community created repos for:

React: https://flowbite-react.com/
Vue: https://flowbite-vue.com/
Svelte: https://flowbite-svelte.com/
Angular: https://flowbite-angular.com/

Contributions are more than welcome too!
Cheers,
Zoltan


djpegli should decode xyb-jpeg to rgb-png

Describe the bug
djpegli should decode xyb-jpeg to rgb-png to ensure that most programs can read it.
To Reproduce
❯ cjpegli --xyb in.png out.jpeg
Read 1920x1080 image, 2048379 bytes.
Encoding [XYB d1.000 AQ p2 OPT]
Compressed to 187502 bytes (0.723 bpp).
1920 x 1080,  52.273 MP/s [52.27, 52.27], , 1 reps, 1 threads.

❯ djpegli out.jpeg out.png
Read 187502 compressed bytes.
1920 x 1080,  56.085 MP/s [56.09, 56.09], , 1 reps, 1 threads.

❯ ffmpeg -i out.png -i in.png -filter_complex libvmaf -f null -
[Parsed_libvmaf_0 @ 0x5d4fcc17d600] VMAF score: 8.031800

Screenshots

Environment

OS: Arch Linux + CachyOS&ALHP Repository
Compiler version: GCC 13.2.1
CPU type: x86_64-v3
cjxl/djxl version string: v0.10.2 e1489592 [AVX2,SSE4,SSE2]

I've also run into this problem.
I assume it wouldn't be a lossless decode, if you convert the colorspace.
Maybe an additional option for this would be a good way to deal with this?

It is lossy encoding, using xyb is just for encoding efficiency. So decoding to rgb should be the default.


InPlaceABN in TResNet.py

I check files but don't find any file or class named InPlaceABN. Is this necessary for running the infer.py script？

In the requirements.txt
<EMAIL_ADDRESS>


Figure 3. How to Define success rate on Kitchen Task.

Thanks for your great work, but I am wondering how you conduct your experiment in kitchen task, i.e. how to calculate success rate on each subtask in Figure 3. I notice that you rollout 48 trajectories for evaluation during training, meaning that there are 60% of these trajectories complete Kettle subtask?

Hi FrankSinatral, we measured whether any of the 48 evaluation trajectories happened to achieve the Kettle subtask (i.e., 0 or 1 for each seed), and averaged over 8 seeds; as a result, the possible values in Fig. 3 are {0, 0.125, 0.25, ..., 0.875, 1.0}.

Thanks for your reply! So it means that in Fig.3 the average success rate (over 8 seeds) of Kettle subtask for example is 0.625, meaning that there are 48*0.625=30 achieving the Kettle subtask, where in code it could be interpreted as given this trajectory (traj in code), the maximum value of traj['env_infos']['metric_success_task_relevant/goal_5'] (5 refers to the Kettle subtask) equals to 1, it seems that the calc_eval_metrics only calculates whether there exists a successful trajectory completing the subtask? Also, I am wondering how many epochs have you trained to obtain the result in Fig.3? Thanks a lot!

I think I was probably not entirely clear in the above response: for Kettle, for each seed, we first check whether there exists at least 1 trajectory (out of 48 evaluation trajectories) that happens to achieve the Kettle task, and then aggregate this boolean value (0/1) assigned to each seed over 8 seeds. We use the evaluation results at epoch 3250.

Thanks a lot! I understand your meaning!


Importing plugins/scripts

The manual entry about plugins is outdated in two major points:

when it mentions "AGSEDIT", this was the old editor's name.
it does not tell how to deal with plugins when you port your game to other systems.

Also, I could not find any information about importing script modules in the manual. Need to make sure one exists and is up-to-date.

I added a small entry on how to do it for linux 0c2232b.

Created a possible entry for a Script Modules page to be added under Other Features

Script Modules
AGS script modules are a way for AGS script code to be reused and shared. They are written in AGS script code entirely, and thus are independent of the platform on which a game is run.
A Script Module is a pair of an AGS Script file and an AGS Script Header file, with an additional metadata.
Managing modules
You can manage them by expanding the Script entry in the tree of Explore Project panel.
You can right click to show options

New script

create a new module from scratch

Import script...

load a module from a .scm file that you have downloaded

New folder

creates folder, which can be used to organize script modules in groups

When you click a module directly, you can use the properties panel to enter a brief description of the module, a version number and authorship details in the module manager when you create a module. Double clicking will expand and revel both the
script and the header files.
Right clicking the module should give you the options:

Rename

Give the module another name

Delete

Removes an existing module from the game

Move up

The order of modules can be important, as it reflects the order in which they are compiled and run, so this option and the next let you change their ordering.

Move down

moves the script module up in the order

Export...

save your own module as a .scm file that you can share with others

You can find useful script modules from others in the Modules & Plugins board in the ags forums.

@morganwillcock I would like your feedback on adding this Script Modules topic. :)

The 'move up' and 'move down' menu items only seem to appear when you right click a folder, right-clicking a module doesn't give the movement options. I'm not sure why there is a distinction between the two, but when I've tried it seems the only way to change the ordering is to drag them on top of each other.
On the plus side the behaviour is so unintuitive and unfriendly to the user that I can easily state that the information must go into the manual. I would say that the impact of ordering on script compilation and execution is probably the most critical part, so an example of the correct order for two example script modules would be good.

Hey @morganwillcock I updated the entry above.
I was going to add the entry but I noticed I had already added a ScriptModules entry!
It's here -> https://github.com/adventuregamestudio/ags-manual/wiki/ScriptModules
It's referenced here, as "Multiple Scripts" -> https://github.com/adventuregamestudio/ags-manual/wiki/ScriptingLanguage
I am unsure how to best proceed now.

IMHO the above entry is meant for the Editor chapter, as it explains the method of managing scripts in the editor's project tree.

As long as the page is not orphaned and the links to the page are also modified, everything should keep working. In theory a broken link is caught by make metacheck but there are no checks for orphaned pages.

Plugins topic was updated a while ago, and now added @ericoporto 's article (here)[ScriptModules]


Bring pycodestyle rules into full compatibility (on SciPy)

Summary
This PR contains a handful of bug fixes that were necessary to get our pycodestyle rules to output identical diagnostics to pycodestyle itself when run on the SciPy repo (which I'm using as "a large, diverse codebase that does not use Black and includes some known violations").

I'm going to carve a couple of these out into separate PRs, so draft for now.


Add files via upload

@RealSweetPanda Thank you for your patience while waiting for a review and processing your request. Pull request merged.
Please start requesting the licenses in about an hour, to let the changes to propagate through our system.


KeyError: 'the label [time] is not in the [index]'

Hello,
Printing the tree of caliper-ex.cali can be done by calling cali-query:
cali-query -q 'select function,sum(sum#time.duration),
inclusive_sum(sum#time.duration) group by
function format json-split' caliper-ex.cali > 0.json

and into hatchet:
>>> import hatchet as ht
>>> gf = ht.GraphFrame.from_caliper_json('./0.json')
>>> print(gf.tree())

but it will fail with:
Traceback (most recent call last):
  File "pandas/core/indexing.py", line 1790, in _validate_key
    error()
  File "pandas/core/indexing.py", line 1785, in error
    axis=self.obj._get_axis_name(axis)))
KeyError: 'the label [time] is not in the [index]'

The traceback is:
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "hatchet/graphframe.py", line 539, in tree
    color=color,
  File "hatchet/external/printtree.py", line 64, in trees_as_text
    color=color,
  File "hatchet/external/printtree.py", line 102, in as_text
    node_time = dataframe.loc[df_index, metric]
  File "pandas/core/indexing.py", line 1472, in __getitem__
    return self._getitem_tuple(key)
  File "pandas/core/indexing.py", line 870, in _getitem_tuple
    return self._getitem_lowerdim(tup)
  File "pandas/core/indexing.py", line 1027, in _getitem_lowerdim
    return getattr(section, self.name)[new_key]
  File "pandas/core/indexing.py", line 1478, in __getitem__
    return self._getitem_axis(maybe_callable, axis=axis)
  File "pandas/core/indexing.py", line 1911, in _getitem_axis
    self._validate_key(key, axis)
  File "pandas/core/indexing.py", line 1798, in _validate_key
    error()
  File "pandas/core/indexing.py", line 1785, in error
    axis=self.obj._get_axis_name(axis)))
KeyError: 'the label [time] is not in the [index]'

The solution is to rename the second column in the json file:

grep columns 0.json
  "columns": [ "inclusive#sum#time.duration", "sum#time.duration", "path" ],

instead of:

grep columns 0.json
  "columns": [ "inclusive#sum#time.duration", "sum#sum#time.duration", "path" ],

My version is:

cali-query --version

2.3.0
caliper-ex.json is actually fine. Am i using cali-query in a wrong way ?
Thanks,
jg.

Hi @jgphpc,
Welcome to Hatchet! You are using cali-query in the correct way. The tree API by default assumes that an index called time exists in the dataframe, but for caliper, the time column really depends on what the user has specified in the query.
In your example, you actually have 2 different time-related columns to choose from. So rather than renaming a column in your dataframe, you can change the metric parameter in the tree API:
 print(gf.tree(metric="inclusive#sum#time.duration"))
and
print(gf.tree(metric="sum#sum#time.duration"))
Hope this helps, and let us know if you have any more questions.

This is amazing 👍 thank you

gf.dataframe.columns

Index(['time (inc)', 'sum#sum#time.duration', 'nid', 'name'], dtype='object')

print(gf.tree(metric="sum#sum#time.duration"))

0.025 main
├─ 0.000 TimeIncrement
└─ 0.000 LagrangeLeapFrog
   ├─ 0.012 LagrangeNodal
   │  └─ 0.002 CalcForceForNodes
   │     └─ 0.002 CalcVolumeForceForElems
   │        ├─ 0.057 IntegrateStressForElems
   │        └─ 0.060 CalcHourglassControlForElems
   │           └─ 0.081 CalcFBHourglassForceForElems
   ├─ 0.001 LagrangeElements
   │  ├─ 0.003 CalcLagrangeElements
   │  │  └─ 0.056 CalcKinematicsForElems
   │  ├─ 0.032 CalcQForElems
   │  │  └─ 0.014 CalcMonotonicQForElems
   │  └─ 0.002 ApplyMaterialPropertiesForElems
   │     └─ 0.045 EvalEOSForElems
   │        └─ 0.096 CalcEnergyForElems
   └─ 0.005 CalcTimeConstraintsForElems

print(gf.tree(metric="time (inc)"))

0.492 main
├─ 0.000 TimeIncrement
└─ 0.467 LagrangeLeapFrog
   ├─ 0.213 LagrangeNodal
   │  └─ 0.201 CalcForceForNodes
   │     └─ 0.199 CalcVolumeForceForElems
   │        ├─ 0.057 IntegrateStressForElems
   │        └─ 0.140 CalcHourglassControlForElems
   │           └─ 0.081 CalcFBHourglassForceForElems
   ├─ 0.249 LagrangeElements
   │  ├─ 0.059 CalcLagrangeElements
   │  │  └─ 0.056 CalcKinematicsForElems
   │  ├─ 0.046 CalcQForElems
   │  │  └─ 0.014 CalcMonotonicQForElems
   │  └─ 0.143 ApplyMaterialPropertiesForElems
   │     └─ 0.141 EvalEOSForElems
   │        └─ 0.096 CalcEnergyForElems
   └─ 0.005 CalcTimeConstraintsForElems

Looks great!! Other things you can do with the tree API are specifying colors (color=True), change precision (precision=2), and specify particular ranks/threads (rank=1, thread=0). We're also working on adding a depth parameter to the tree, so you can opt to print a certain number of levels of the tree if your tree has many levels.


Fixed text replies working, also fixed reply chains for multiple mess…

…age responses

Force merging as no one else is on this project, I have ensured that the changes work as intended


⚠ 366.ru has degraded performance

In 6624bf1, 366.ru (https://366.ru) experienced degraded performance:

HTTP code: 200
Response time: 1645 ms

Resolved: 366.ru performance has improved in 57a121d.


DOC: fix typo in documentation for Row method

Done!
I also  edited the commit message of the original commit in this PR to reflect your comment.
Thanks

@kortschak I'm not sure what our policy is with using the "Dismiss review" button before changes like this. Do we have a strict policy, or just "better judgement"? Basically, not sure if I should dismiss review and submit, or wait for you to give explicit approval.

@btracey I'm treating the changes as needing requester approval or approval from 2 other reviewers.

Thank you @sglyon

I think "use judgement", in this case the request is obvious and any approver would be OK. In other cases the request may be more subtle.

Great, I agree.


Merging of launch_template_tags from self_managed_node_group_defaults with the ones inside self_managed_node_groups does not work

Description
It is possible to add "launch_template_tags" to both the  "self_managed_node_group_defaults" sections and inside a self-managed node group node group like the following:
self_managed_node_group_defaults = {
…
   tag_specifications = [
     "instance",
     "volume",
     "network-interface"
   ]
   launch_template_tags = {
     auto-delete = "no",
   }
 }

 self_managed_node_groups = {
   smng-ond = {
     name = "smng-ond"
…
     tag_specifications = [
       "instance",
       "volume",
 # ENI incurres no cost !
 #     "network-interface"
     ]
     launch_template_tags = {
       cost-bu    = "smng-ond"
       cost-center = "08101965"
     }

But currently only the ones inside the node group definition are used and the default ones are overwritten/lost.
The idea here is to have common tags (like auto-delete) to apply per default to all resources like EC2 instances in all node groups and node group specific tags tags like cost-center to only particular node group.
Versions

Module version [Required]: 19.10

Terraform version: 1.3.9

Provider version(s): AWS provider 4.56

Reproduction Code [Required]

See TF snippet above
Expected behavior
All tags from both sections are  applied to the respective resources defined in " tag_specifications"
Actual behavior
Only the tags from within the self-managed node group definition are applied.

After looking at the module I believe merging is not possible because of usage of "try" function for this variable herehttps://github.com/terraform-aws-modules/terraform-aws-eks/blob/master/node_groups.tf#L453. Can someone please confirm, thx!


NullPointerException for TradeParties without street in address

If a TradeParty has no street in de address, then a NullPointerException is thrown when generating the XRechnung. Addresses with a postal code but without a street are valid in Germany.
Stacktrace:
java.lang.NullPointerException
	at org.mustangproject.XMLTools.encodeXML(XMLTools.java:48)
	at org.mustangproject.ZUGFeRD.ZUGFeRD2PullProvider.getTradePartyAsXML(ZUGFeRD2PullProvider.java:159)
	at org.mustangproject.ZUGFeRD.ZUGFeRD2PullProvider.generateXML(ZUGFeRD2PullProvider.java:420)
	at org.mustangproject.ZUGFeRD.ZUGFeRDExporterFromA3.prepare(ZUGFeRDExporterFromA3.java:526)
	at org.mustangproject.ZUGFeRD.ZUGFeRDExporterFromA3.setTransaction(ZUGFeRDExporterFromA3.java:521)
	at com.sernet.faktura2.core.zugferd.InvoiceCreator.addInvoiceToPDF(InvoiceCreator.java:62)
        ...

Apparently there was a bit of a legal back-and-forth in the past, the BGF ruled that Street was required in AZ VR 23/14 (https://www.handwerksblatt.de/themen-specials/rechnungen-darauf-kommt-es-an/strenge-anforderungen-an-die-rechnungsanschrift) but was overruled by the EuGH  https://www.haufe.de/steuern/rechtsprechung/kein-vorsteuerabzug-bei-rechnungen-mit-postfachadresse_166_325834.html


Add representative time mapping

Codecov Report
Attention: Patch coverage is 90.03831% with 26 lines in your changes missing coverage. Please review.

Project coverage is 92.69%. Comparing base (f9d18c9) to head (aa4760c).

Files with missing lines
Patch %
Lines

src/chronify/time_configs.py
70.21%
14 Missing :warning:

src/chronify/time_series_mapper_representative.py
91.07%
10 Missing :warning:

src/chronify/time_series_mapper.py
71.42%
2 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #19      +/-   ##
==========================================
- Coverage   93.50%   92.69%   -0.81%
==========================================
  Files          18       22       +4
  Lines         831     1068     +237
==========================================
+ Hits          777      990     +213
- Misses         54       78      +24

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

🚨 Try these New Features:

Flaky Tests Detection - Detect and resolve failed and flaky tests


Update mkdocs-material to 7.1.0 (SOFTWARE-4584)

Hi @mtru32 the virtual school pages are particularly important since the school is starting in a few days. @osg-cat: I'm not expecting any differences between the two mkdocs versions that would affect the school pages (we've already updated https://opensciencegrid.org/docs/) but I will defer to you if you'd like to punt on this until after the school

Would it be possible to revert if things go badly?

Of course! And @mtru32 can verify that the existing pages look the same between the new version and what's in production (https://opensciencegrid.org/virtual-school-2021/)

Right, but we are on the cusp of starting to add the complex stuff — it’s not there yet. Let me at least get through the schedule tables today, as we discussed on Slack, and then think about it some more. This is a per-site change, right?

Yup, it's per site


[NOT TESTED] Permit the use of 4-pin stepper motors.

https://www.arduino.cc/en/Reference/StepperConstructor - the constructor permits two types of stepper motors (only one of them is supported in nanpy, but 4-pin motors are very common).
I do not know how the code works and I am just guessing. I will test it in a day when I have access to the stepper motor.
The order of the arguments is awkward for backward-compatibility purposes.

Thanks! Please, consider to update the firmware part as well https://github.com/nanpy/nanpy-firmware/blob/master/Nanpy/StepperClass.cpp
And please test your code before :smile: waiting for updates from you...

I tested it earlier today and it works with the updated firmware (not provided in this pull request). However, how can I write firmware that would work with both 2 pins and 4 pins? Do I need to define 2 different c++ classes?

No, Nanpy firmware doesn't support 4 pins at the moment. You need to call a different constructor here, depending on how many parameters you pass to the function:
https://github.com/nanpy/nanpy-firmware/blob/master/Nanpy/StepperClass.cpp#L18
Use m->getNArgs() to see how many parameters are you passing. If the number of paramters is 5 then you're using 4 pins, else you're using 2 pins. Something like this:
        if (strcmp(m->getName(),"new") == 0) {
            int prm = 0;
            if (m->getNArgs() == 5) {
                v.insert(new Stepper (m->getInt(prm++), m->getInt(prm++), m->getInt(prm++)));
           } else {
                v.insert(new Stepper (m->getInt(prm++), m->getInt(prm++), m->getInt(prm++), m->getInt(prm++), m->getInt(prm++)));
           }
            m->returns(v.getLastIndex());
        }

Take a look at the firmware and open a PR with the changes required.

Noted. I will update both over the weekend.

Many thanks @Krastanov ! Feel free to ask me any kind of help you need in the implementation and thanks for contributing to Nanpy! :smile:

Pull requests https://github.com/nanpy/nanpy-firmware/pull/21 and https://github.com/nanpy/nanpy/pull/65 cover everything from here, so I am closing this PR. Thanks for the detailed explanations.


Weekly data issue - 29 Jan is Friday and it is not start of week

I am also having the same issue using the 1wk interval where the week starts on Friday. Based on your screenshot I wonder if this is a yfinance issue or an issue on Yahoo's end?

Because either:

You are collecting on friday
friday was a holiday.
Solution: filter your pandas dataframe using the weekday == 0 flag if you want mondays only.


Purple border color

He3 seems to suffer from a strange purple border. Would be nice to get rid of it.

Somehow it just disappeared. Fixed I guess 😂

Ok, it occasionally appears again. Would be nice to not have that issue 🚀

Yeah, it's nod to the window's drag state - dragging something into the view will lite it, kinda a visual handle bar.

Fixed post build 8418 - "might" make it to 1.0.4 in review.

I've got this too. Would definitely prefer not to have it.
Would be nice to have non-rounded corners on the window as a whole too but not sure what's possible.


Payment proof: for transactions with assets the amount is displayed in beam

For transactions in assets the amount in payment proof is displayed in beam
Steps:

Send some asset amount from the wallet
Copy payment proof code
Go to the settings > utilities > payment proof
Insert copied payment proof code

Actual: the amount is displayed in beam
Expected: the amount is displayed in asset

The same problem when user shares transaction details

Checked


Linalg

Decomposition functions and tests.
Renamed svd_decomposition, qr_decomposition, rq_decomposition to svd, qr, rq.
Some backend changes to make functions work.
Changes throughout to respect new names.
High level names (e.g. MPS) untouched.
Minor changes to silence warnings.

Hey @alewis, would you like to make a PR to master with renaming svd_decomposition, qr_decomposition, ...? There's no reason to wait with this.


Chest textures

For whatever reason, the chests seem to have two textures when I place them. As the pictures show (apologies for quality), depending on the angle I place them, the chest will either have two textures on top of each other, or two textures at different angles. With double chests, you either get a weird texture that flickers, or one that still shows the individual single chest textures and the double chest.
This occurs for all the different variants. I did check whether it was a chest issue in general, but the vanilla chest and other mod chests are fine. I'm on 1.21.1 with fabric loader, version 1.5.6 of the Mod.

What other mods are you running? I can't replicate the issue with just More Chest Variants.

@JavierMNew Your issue is Fast Chest, click the link to make an issue and reference this one.
I expect its the same for you @RubberDingy168.

@JavierMNew Your issue is Fast Chest, click the link to make an issue and reference this one.
I expect its the same for you @RubberDingy168.

tysm it worked, amazing mods


Gitlens for submodules

I noticed gitlens doesn't work for submodules. When you have a project and inside it you have one or more submodules, gitlens completely ignore them.
Do you plan to implement this functionality by chance?

I've never used submodules myself, so I'm not familiar with them. I did a bunch of work a while back to support sub-repos (and I think that still works, though I believe I noticed a bug the other day). When you say that it just ignores them, what does that mean exactly? You could also try turning on the output logging via "gitlens.output.level": "verbose" setting and see if there are any error messages there.

There isn't any error message coming. Only a warning like this:
"Unable to show commit details. File is probably not under source control" when I, for example, try to use "Show commit details" on a file that is under the submodule.
When I say that gitlens ignores it I mean that the extension doesn't work at all on a file versioned by a submodule.

That warning should generate a much better message in the GitLens output channel if you turn set "gitlens.output.level": "verbose". Can you turn that on, and retry? Then post the logs here?

@eamodio I tried doing that.. did this configuration then under the output tab nothing is shown. Is the any other thing I could do?

Sorry I gave you the wrong setting, its "gitlens.advanced.output.level": "verbose" -- that's what I get for not looking it up first.

Now we go! =)
This happens when, for example, I open a file tfsa-directives.js which is under the submodule.
CodeLens config changed; resetting CodeLens provider
Triggering a reset of the git CodeLens provider
getBlameForFile('/data/dev/wpd', '/data/dev/wpd/src/main/resources/templates/phn/html/js/dashboard/accounts/tfsa-directives.js', undefined)
Add blame cache for '/data/dev/wpd/src/main/resources/templates/phn/html/js/dashboard/accounts/tfsa-directives.js'
git blame --root --incremental -- src/main/resources/templates/phn/html/js/dashboard/accounts/tfsa-directives.js   cwd='/data/dev/wpd'
  Error: fatal: no such path 'src/main/resources/templates/phn/html/js/dashboard/accounts/tfsa-directives.js' in HEAD  Failed with exit code: 128
getBlameForFile('/data/dev/wpd', '/data/dev/wpd/src/main/resources/templates/phn/html/js/dashboard/accounts/tfsa-directives.js', undefined)
getBlameForFile('/data/dev/wpd', '/data/dev/wpd/src/main/resources/templates/phn/html/js/dashboard/accounts/tfsa-directives.js', undefined)

@thiagoh thanks for the output -- I think I broke this in one of the more recent updates :(
I'll look into fixing it

Thank you @eamodio
Tell me if you need some help with that..

@thiagoh do you happen to have a repo that has a submodule that I can clone to test with?

@eamodio, unfortunately the repo with submodules I use is private. However, if you could create one repo with submodules to test you'll see that is quite simple:
Take these examples:

http://stackoverflow.com/questions/5828324/update-git-submodule-to-latest-commit-on-origin/5828396#5828396
https://gist.github.com/gitaarik/8735255

@thiagoh could you try a test with this: gitlens-3.1.1.zip
To install it first rename it to gitlens-3.1.1.vsix, then make sure to uninstall the current version of GitLens from vs code (and reload), then use the Install from VSIX... menu choice from the ... extensions menu.

@eamodio I'm sorry for the delay..
Look, when I tried to install from the .vsix file I got the following error
end of central directory record signature not found

@thiagoh Not sure what happened there -- very odd. But I've just published v3.2.0 to the marketplace -- please try that out and let me know if it works for you. Thanks!

@eamodio working perfectly! thank you so much!

@thiagoh excellent news! Closing this out then :)

Hey @thiagoh, how are you seeing the submodules?
I don't see my submodule, I just see this:

These don't work for me either. I think you should reopen the issue.

@vladipus Can you provide more details to the structure of your project (hierarchy of where the git repo is and the submodules)? Or if its an open source repo, point me to it?

Bump,
Git submodules are super common these days.
Is anyone working on this right now?

@andygikling Have you tried with GitLens 9? And if so, can you detail what isn't working that you expect to be working? Thanks!

First of all I love what Gitlens is all about.  I looked closer at it.  There are two main problems.
The first issue is yes it shows submodules but it doesn't recuse the folder tree looking for more.  It only shoes submodules for git directories directly below the current VS code active folder.  Maybe this is intended though.
My repo structure looks like this:
-GitRepoMaster
----NormalCodeFolder
----GitSubmodule1
----GitSubmodule2
----GitSubmodule3
--------GitSubmodule3.1
--------GitSubmodule3.2
And on the treeview in Gitlense is see this:
-GitRepoMaster
----GitRepoMaster (GitSubmodule1)
----GitRepoMaster (GitSubmodule2)
----GitRepoMaster (GitSubmodule3)
But I suppose I expected to see this (more per SmartGit and Kracken):
-GitRepoMaster
----GitSubmodule1
----GitSubmodule2
----GitSubmodule3
--------GitSubmodule3.1
--------GitSubmodule3.2
Note the way the names look is different - () is missing and the tree should show a physical indentation.
And you show all the submodules.
Let me know what you think @eamodio

@andygikling Thanks! You can control the depth that GitLens searches for repositories by default by changing the gitlens.advanced.repositorySearchDepth setting. It currently defaults to 1 for performance reasons. Also, GitLens should automatically discover new repositories as you open new files from those repos.
Let me know if that works for you.
As for the naming -- I went with that structure to mirror the workspace folders you have open in vscode, although if you have only 1 workspace folder open then maybe that structure is overkill. I'll have to look into that a bit more.

Fantastic!  Well done sir.  Sorry I didn't know about the search depth option!
Naming decision makes sense.  Thank you.

Of course!  Thank you.

Does the default of 1 for gitlens.advanced.repositorySearchDepth mean that it searches for submodules at the first level in a git repo?  i.e. if I have a submodule at the root of my git repo, it should find it?  For me, the submodule was not found until i opened a file in it even though it's at the root of my git repo.

Lol.  I increased it to 2 and it found the git repos that were at depth 2 but not the one at depth 1.

Bump,
I have been having issues with this as well.
Main Git Repo
|--File_Directory
|--SubModule A
|--SubModule B
|--SubModule C
|--SubModule C-1
|--SubModule D
I am able to get GitLens to recognize the SubModule (including the nested one) If open files in each Submodule. After VSCode reloads though, they are gone and I have to open a file again.
I have tried the gitlens.advanced.repositorySearchDepth, but it hasnt changed anything (varied from 1 to 4).

I'm using subrepos inside the main git repo and can't see my subrepos as well, regardless of gitlens.advanced.repositorySearchDepth

For me, the submodule was not found until i opened a file in it even though it's at the root of my git repo.

This worked for me, thanks.

@ramusz1 To be clear, though, that is just a work-around.  IMHO, the plugin should see all submodules without one having to navigate to one and open a file in one.

But if people are still seeing this, like @ramusz1 apparently is, why is this issue closed?

I also continue to experience this problem, with gitlens 10.2.2 on platformio.  It sometimes works, and sometimes doesnt.  Not sure why it starts and stops. I had a code review the other day, and all of a sudden my subrepos disappeared and I was SOL. it was really frustrating.
Could gitlens just look at the .gitmodules file to see where submodules should be?
Or could we specify paths to submodules inside of our workspace settings?


Warning for tuple_size and tuple_element with -Wall on clang++/g++ on Linux

I get these warnings on g++ 8.2.1 and clang++ 7.0.1 when compiling on Linux with -Wall set:
ctre/ctre/include/ctre/return_type.hpp:229:34: warning: 'tuple_size' defined as a class template here but previously declared as a struct template [-Wmismatched-tags]
        template <typename... Captures> class tuple_size<ctre::regex_results<Captures...>> : public std::integral_constant<size_t, ctre::regex_results<Captures...>::size()> { };
                                        ^
/usr/bin/../lib64/gcc/x86_64-pc-linux-gnu/8.2.1/../../../../include/c++/8.2.1/array:350:5: note: did you mean class here?
    struct tuple_size;
    ^
/usr/bin/../lib64/gcc/x86_64-pc-linux-gnu/8.2.1/../../../../include/c++/8.2.1/utility:84:5: note: did you mean class here?
    struct tuple_size;
    ^

...

ctre/ctre/include/ctre/return_type.hpp:231:44: warning: 'tuple_element' defined as a class template here but previously declared as a struct template [-Wmismatched-tags]
        template <size_t N, typename... Captures> class tuple_element<N, ctre::regex_results<Captures...>> {
                                                  ^
/usr/bin/../lib64/gcc/x86_64-pc-linux-gnu/8.2.1/../../../../include/c++/8.2.1/array:359:5: note: did you mean class here?
    struct tuple_element;
    ^
/usr/bin/../lib64/gcc/x86_64-pc-linux-gnu/8.2.1/../../../../include/c++/8.2.1/utility:110:5: note: did you mean class here?
    struct tuple_element;
    ^

It looks like a previous iteration of that file uses struct - is this because your compiler (MSVC?) uses class for those forward declarations instead? Do you know of any way to cleanly get rid of those warnings apart from editing the file itself?

It's problem with C++ standard in this case where struct/class is mismatched.
https://github.com/cplusplus/draft/issues/534
http://eel.is/c++draft/tuple.helper#lib:tuple_size,in_general
I'm not sure what I can do with it :(
GCC and Clang I'm using with -Wall is not giving me any warning.

I am not sure but does the name have to be std::tuple_size std::tuple_element.  I am fairly sure that specializing these is UB.  Plus, not including  may help compile time.
Giving these items another name or putting them into the ctre namespace may be effective.

Well darn. Thanks for the insight. Feel free to close this issue if nobody is able to find a workaround.
FWIW I'm on Arch Linux, if anyone else runs in to this.

@beached std::tuple_element and std::tuple_size are customization points and you can overload them and they must be in std:: namespace.

I also fixed inconsistency in the wording: https://github.com/cplusplus/draft/commit/6f34b0513ed6d974b86a27429f8f4d02a6c18b88


Tenant Route not resolving

I need your help
I get the error while trying to reset a tenants password ?
Route [password.request] not defined.
Here is my tennant.php file
`
use Illuminate\Support\Facades\Route;
Route::middleware(['web','tenancy.enforce'])
->namespace('App\Http\Controllers')
->as('tenant.')
->group(function () {
Route::get('login', '\Auth\LoginController@showLoginForm')->name('login');
Route::post('login', 'Auth\LoginController@login');
Route::post('logout', 'Auth\LoginController@logout')->name('logout');

Route::get('password/reset', 'Auth\ForgotPasswordController@showLinkRequestForm')->name('password.request');
Route::post('password/email', 'Auth\ForgotPasswordController@sendResetLinkEmail')->name('password.email');
Route::get('password/reset/{token}', 'Auth\ResetPasswordController@showResetForm')->name('password.reset');
Route::post('password/reset', 'Auth\ResetPasswordController@reset');

Route::get('/', function () {
    return view('welcome');
});`

can you make sure it's tenants.php not tennant.php?

My bad, that was a typo. Its actually tenants.php

You've defined a route name prefix of "tenant." for these routes. Try route('tenant.password.request') or remove the call to ->as('tenant.')

@36864 Thanks for your suggestions, I have removed the prefix "tenant." and as well as ->as('tenant.')
and I now get this new error    Route [register] not defined.

Probably because you haven't defined any route with that name in your file, and at least one of the files you're using is trying to call route('register').

Thank you very much @36864 I had to define the route('register').
So its working now.


Creating jobqueue scheduler-specific teams

So I am the current bottleneck in Dask-Jobqueue, I am able to devote 4 hours per week max on this (when @guillaumeeb was the main person involved it was the same thing for him).
For some time I have been thinking that having a way to ping jobqueue scheduler-specific people easily could help because they can help debug cluster-specific things and help figure out whether this is a problem in Dask-Jobqueue, a jobqueue scheduler specific thing, a site local cluster-specific thing etc ...
OK so here is my first attempt to make a list of volunteers by jobqueue scheduler let me know if I have missed some obvious candidates:

SLURM @rcthomas @willirath @kathoef @jhamman (maybe more on Kubernetes these days in which case feel free to say no) @lesteve
LSF @d-v-b @stuarteberg (hopefully you haven't changed opinion since the Dask workshop a few months ago :wink:)
PBS @guillaumeeb actually is there anyone else there was a MoabCluster implementation that is supposed to be PBS-like but I have never heard back since probably that means it "just works" or it is rather useless ...
SGE @ericmjl @lesteve
HTCondor @mivade @matyasselmeci @riedel
OAR @lesteve maybe I can find someone else in France, let's see, same thing I know some (~5-10) people are using it and I have never heard too much back ...

I guess the easiest if is you just reply quickly in this issue you are fine being added to such a list. Any other feed-back about the general idea more than welcome!
Another thing
For more about how to get more people involved on Dask-on-HPC see https://github.com/dask/community/issues/43, don't hesitate to get involved there.
This goes without saying but this is opt-in only, and there the only very tiny moral contract is that from time to time (I would estimate less than once a week) I may ping you when I feel it is a jobqueue scheduler specific thing and if you have some spare bandwidth at this particular moment to help debug the problem that would be greatly appreciated!

cc @raybellwaves (who wrote the LSF implementation originally IIRC)

Sounds like a good way of structuring this. (Thanks for the constant work you've put into this @lesteve!)

Sounds good to me, too!

Gonna reach out to colleagues at UM to see if they interested in any feedback/dev etc. for LSF

Count me in, @lesteve. Definitely appreciate the help you’ve rendered thus far. May I also nominate @sntgluca to join me as well? (Please feel free to decline, Gianluca :smile:.)

Of course I'm in. I'm still hoping I can also find again up to half a day for dask and dask-jobqueue. Or else get someone here at CNES work on it. For PBS, you can also add @jhamman and @andersy005 and maybe @kmpaul !

@lesteve / @guillaumeeb , I am happy to join as well.

@ocaisa if you want to get involved in this, let me know!
I just saw your comment in https://github.com/dask/community/issues/43) and realise that I did not mention you here although you have made very useful contributions.

I really need to get better at following up with you guys...
Dear @ericmjl I am in.

@ocaisa if you want to get involved in this, let me know!
I just saw your comment in dask/community#43 and realise that I did not mention you here although you have made very useful contributions.

Yes, sure, I am happy to help out

So I have created the teams:

@dask/dask-jobqueue  is the parent team everybody should be in it and have Triage permissions to open/close issues add labels etc ... do feel free to use these rights as much as you see fit!
each scheduler has a team e.g. @dask/dask-jobqueue-slurm.

Thanks everyone I am going to close this one
I am still missing @sntgluca and @stuarteberg. Probably the Dask organization invitation  has been lost deep into one of your inbox. Apparently you should be able to see and accept the invitation here:
https://github.com/orgs/dask/invitation

@lesteve I'm now a member of the dask org. Please add me to the LSF team!  Thanks.

Done :)

Thanks everyone, I managed to get the few last persons remaining added. As part of the process I also learn that org invitation can go out of date which I did not know ...

As part of the process I also learn that org invitation can go out of date which I did not know ...

Good to know. Do you know when they go out of date? 24hrs? Longer?

org invitation can go out of date

Do you know when they go out of date? 24hrs? Longer?

My invitation said 7 days.

It was more than one week, my bad... at the time I didn't have time to follow up.
Thank you for the new one!!

@andersy005 I didn't join, but please keep me in the loop on this.  If I have time to help, I'm happy to.

@andersy005 I didn't join, but please keep me in the loop on this. If I have time to help, I'm happy to.

Will do


python linkchecker component

The python linkchecker is a basic checker which runs through a series of webpages identifies links and tries to resolve them, it reports in a number of potential output formats (xml, sitemap, sql)
The checker can run as a ci-cd script in a container
docker run --rm -it -u $(id -u):$(id -g) ghcr.io/linkchecker/linkchecker:latest --verbose https://www.example.com

results can be written to a location to be picked up by a process, for example a set of sql statements to be run against a DB

we already identified some challenges with this tool (and other tools):

linkchecker can not a accept:html header, pycsw currently requires this header to return html, add ?f=html as a workaround
pycsw maxpagesize (currently 20) is too low, better to use 100
use --verbose and --check-extern to add full checking and logging

example
linkchecker https://soilwise-he.containers.wurnet.nl/cat/collections/metadata:main/items?f=html --verbose --check-extern

since the soilwise catalogue is not online yet, suggestion is to use a catalogue of ejpsoil
https://catalogue.ejpsoil.eu/collections/metadata:main/items?f=html


error when using

after ]dev GPUCompiler MetalCore, brew install cmake, git clone git@github.com:PhilipVinc/cmt.git, ln -s /Users/arthurb/src/cmt .julia/dev/MetalCore/cmt i get the following error:
julia> using MetalCore
[ Info: Precompiling MetalCore [dde4c033-4e86-420c-a63e-0dd931031962]
ERROR: LoadError: LoadError: syntax: invalid iteration specification
Stacktrace:
 [1] top-level scope at /Users/arthurb/.julia/dev/MetalCore/src/execution/kernel.jl:84
 [2] include(::Function, ::Module, ::String) at ./Base.jl:380
 [3] include at ./Base.jl:368 [inlined]
 [4] include(::String) at /Users/arthurb/.julia/dev/MetalCore/src/MetalCore.jl:1
 [5] top-level scope at /Users/arthurb/.julia/dev/MetalCore/src/MetalCore.jl:25
 [6] include(::Function, ::Module, ::String) at ./Base.jl:380
 [7] include(::Module, ::String) at ./Base.jl:368
 [8] top-level scope at none:2
 [9] eval at ./boot.jl:331 [inlined]
 [10] eval(::Expr) at ./client.jl:467
 [11] top-level scope at ./none:3
in expression starting at /Users/arthurb/.julia/dev/MetalCore/src/execution/kernel.jl:84
in expression starting at /Users/arthurb/.julia/dev/MetalCore/src/MetalCore.jl:25
ERROR: Failed to precompile MetalCore [dde4c033-4e86-420c-a63e-0dd931031962] to /Users/arthurb/.julia/compiled/v1.5/MetalCore/ACDsk_Mctac.ji.
Stacktrace:
 [1] error(::String) at ./error.jl:33
 [2] compilecache(::Base.PkgId, ::String) at ./loading.jl:1290
 [3] _require(::Base.PkgId) at ./loading.jl:1030
 [4] require(::Base.PkgId) at ./loading.jl:928
 [5] require(::Module, ::Symbol) at ./loading.jl:923

I pushed some dead code last time...
should be fixed now.

BTW, this was an experiment I did months ago, but apart from giving slightly nicer bindings to the raw metal apis, it does not do much.
Unfortunately hooking up the infrastructure necessary to compile Julia functions into metal kernels is considerable work that I cannot do. At the time this code is here waiting for someone to pick it up.


Running multiple times fails at Installing Homebrew taps and extensions

I stopped strap.sh a few times while collecting information for https://github.com/mikemcquaid/strap/issues/33 and now I'm seeing a failure later on:
--> Installing Homebrew taps and extensions:
Succeeded in tapping caskroom/cask
Succeeded in tapping homebrew/services
Succeeded in tapping homebrew/versions
Error: Tap caskroom/cask already tapped.
Failed in installing caskroom/cask/brew-cask

Success: 3 Fail: 1
!!! Installing Homebrew taps and extensions: FAILED
!!! Run './strap.sh --debug' for debugging output.

With --debug:
+ log 'Installing Homebrew taps and extensions:'
+ STRAP_STEP='Installing Homebrew taps and extensions:'
+ echo '--> Installing Homebrew taps and extensions:'
--> Installing Homebrew taps and extensions:
+ brew tap
+ grep -i Homebrew/bundle
homebrew/bundle
+ STRAP_BREWFILE=/tmp/Brewfile.strap
+ cat
+ brew bundle --file=/tmp/Brewfile.strap
Succeeded in tapping caskroom/cask
Succeeded in tapping homebrew/services
Succeeded in tapping homebrew/versions
Error: Tap caskroom/cask already tapped.
Failed in installing caskroom/cask/brew-cask

Success: 3 Fail: 1
+ cleanup
+ sudo -k
+ rm -f '' /tmp/Brewfile.strap
+ '[' -z '' ']'
+ '[' -n 'Installing Homebrew taps and extensions:' ']'
+ echo '!!! Installing Homebrew taps and extensions: FAILED'
!!! Installing Homebrew taps and extensions: FAILED
+ '[' -z 1 ']'

I tried brew untap caskroom/cask, but it fails in the same way.

Tried 'manually' untapping, same result:
--> Installing Homebrew taps and extensions:
Succeeded in tapping caskroom/cask
Succeeded in tapping homebrew/services
Succeeded in tapping homebrew/versions
Error: Tap caskroom/cask already tapped.
Failed in installing caskroom/cask/brew-cask

Success: 3 Fail: 1
!!! Installing Homebrew taps and extensions: FAILED
!!! Run 'strap.sh --debug' for debugging output.
!!! If you're stuck: file an issue with debugging output at:
!!!   https://github.com/github/strap-internal/issues/new

The only workaround I found was to remove change:
cat > "$STRAP_BREWFILE" <<EOF
tap 'caskroom/cask'
tap 'homebrew/services'
tap 'homebrew/versions'
brew 'caskroom/cask/brew-cask'
EOF

to:
cat > "$STRAP_BREWFILE" <<EOF
tap 'homebrew/services'
tap 'homebrew/versions'
EOF

After that, strap.sh succeeded. I tried manually installing brew cask, but it seems to be there already:
$ brew install caskroom/cask/brew-cask
Error: Tap caskroom/cask already tapped.

Is it possible something is installing it already?

I ran into this as well. I got around this by brew untap caskroom/cask and then brew install caskroom/cask/brew-cask I believe...

I think this may be an upstream Homebrew Bundle error CC @xu-cheng

This was just fixed in https://github.com/Homebrew/homebrew/commit/ea6c8f7e2dc8f1adf8df9065468d0b37047d4a46

@xu-cheng Thanks!
@technicalpickles If you rerun Strap this is now fixed.

Thanks! I ended up restoring from time machine, which was using boxen so I can't verify now. I'll test when my new computer comes in though.


renamed py-electrolux-ocp to pyelectroluxocp

Renamed the package so it can be imported much easier

Thanks for suggestion, but I was in the middle of changes, could not merge your PR that simply.
And just before publishing the package to pip renamed it without dashes.


Get-Content -ReadCount 0  combined with -Last / -Tail seems to read ALL lines internally

Get-Content -ReadCount 0 is a convenient way to request that all lines be read at once, into an array and to have that array be output as a single object to the success stream.
When combined with -First aka -TotalCount aka -Head, this sensibly allocates an array for and outputs only the requested number of lines from the beginning, not for all lines.
Note: Meaningfully combining -First with -ReadCount 0 was only recently implemented, in #10749.
While combining -Last aka -Tail with -ReadCount 0 is functional,  performance timings suggest that all lines are needlessly being read into an array behind the scenes, before only the sub-array of interest is output.
In other words: while -Tail <n> -ReadCount 0 should be the same as -Tail <n> -ReadCount <n> (explicitly setting the the read count to the same number as the number of trailing lines requested), it currently isn't in terms of performance and memory use.
Steps to reproduce
# Create a temporary file with 1 million lines
$f = [IO.Path]::GetTempFileName(); (, 'foo') * 1e6 > $f
# Warm up the cache.
$tmp = gc $f -ReadCount 0

# Read 1000 lines from the end, as a single array
$n = 1000
{ $v = gc $f -Tail $n -ReadCount $n },
{ $v = gc $f -Tail $n -ReadCount 0  },
{ $v = gc $f          -ReadCount 0  } <# control: read all lines #> |  % {
  "$_`: " + (Measure-Command $_).TotalSeconds
}

Remove-Item $f

Expected behavior
-Tail $n -ReadCount $n and -Tail $n -ReadCount 0 should perform virtually the same and should be faster than -ReadCount 0 by itself.
Actual behavior
-Tail $n -ReadCount 0 is not only slower than -Tail $n -ReadCount $n , but also slower than -ReadCount 0  by itself, suggesting that all lines were read behind the scenes.
 $v = gc $f -Tail $n -ReadCount $n : 0.1515997
 $v = gc $f -Tail $n -ReadCount 0  : 0.2118531
 $v = gc $f          -ReadCount 0  : 0.209674

Environment data
PowerShell Core 7.0.0-rc.2

Looked into this a bit.  I think you discovered an interesting issue / circumstance.  In PowerShell Core, the [IO.Path]::GetTempFileName(); (, 'foo') * 1e6 > $f command produces a UTF-8 file without a byte-order-marker (BOM).  Side note: This differs from Windows PowerShell which produces a UTF-16 with a BOM.  When processing UTF-8 data with no BOM, the Get-Content cannot detect the file encoding when the file is read in reverse.  As a result, it does a forward search which enumerates the whole file (albeit in different chunk sizes depending on ReadCount -- which might explain your performance differences).  Can you confirm that doing the following changes the behavior for you?
$f = [IO.Path]::GetTempFileName()
(, 'foo') * 1e6 | Set-Content -Encoding utf8BOM -LiteralPath $f

Intriguing, @NoMoreFood, thanks for the sleuthing - using a file with a BOM indeed makes a big difference in the resulting performance (and even seems to make -ReadCount 0 marginally faster than -ReadCount $n)
I would never expect Get-Content to detect encodings, however: if a BOM is present, the encoding is unambiguously specified; in the absence of a BOM, the default encoding should be assumed (UTF-8 in PS Core), so there is no good reason for this variation in behavior.

Yeah, I think you're right and I believe I see the detection bug in the code.  More to come....

@iSazonov It appears Get-Content -Tail already has a decent set of tests to validate the encodings.  The tests of interest passed before and they continue to pass after the change.  However, I saw some new explicit encodings were not in the list to I added them to this pull.
However, this pull addresses a performance bug which obviously can run differently on every system and every execution so it would be nearly impossible to include a reliable pass/fail test for something like this without adding specific debug tracing to the code in order to validate the code path of interest is hit or not hit; I do not see any precedent for that in other tests.  In absence of that, I am providing a code snippet to verify obviously demonstrate the performance before and after the change:
Test Code:
$Encodings = @('String','OEM','Unicode','BigEndianUnicode',
    'UTF8','UTF8BOM','UTF8NoBOM','UTF7','UTF32','Ascii')
$TempFile = (New-TemporaryFile).FullName
$Results = @()
ForEach ($Encoding in $Encodings)
{
    (1..2e6) | Set-Content -Encoding $Encoding -LiteralPath $TempFile -Force
    $Time = Measure-Command { $Capture = Get-Content -Tail 1 -LiteralPath $TempFile }
    $Results += New-Object PSObject -Property @{'Encoding'=$Encoding;'Time'=$Time.TotalMilliSeconds}
    Remove-Item -LiteralPath $TempFile -Force
}
$Results | Format-Table -AutoSize

Before Change:
Encoding             Time
--------             ----
String            12.3904
OEM              585.5496
Unicode            1.2809
BigEndianUnicode   1.1258
UTF8             555.5736
UTF8BOM            0.9639
UTF8NoBOM        647.7248
UTF7             560.4215
UTF32              1.1847
Ascii            562.1341

After Change:
Encoding           Time
--------           ----
String           2.8139
OEM              0.8078
Unicode          0.8523
BigEndianUnicode 0.9938
UTF8             0.7483
UTF8BOM          0.7559
UTF8NoBOM        0.7721
UTF7             0.8044
UTF32            1.1415
Ascii            0.9463

Notice the performance improvements for UTF-8 / UTF-8 NoBOM / UTF-7 / Ascii / OEM (which are all interpreted as UTF-8 by Get-Content given they are all indistinguishable with the provided test character set) .  This latter performance is consistent to what you'd see from Windows PowerShell.


{Mysql} az mysql flexible-server import create: Add firewall rule migration from single to flex

Related command
az mysql flexible-server import create
Description
This PR adds the logic for firewall rule migration from single server to flex server for a public access enabled server.

This checklist is used to make sure that common guidelines for a pull request are followed.

[x] The PR title and description has followed the guideline in Submitting Pull Requests.

[x] I adhere to the Command Guidelines.

[x] I adhere to the Error Handling Guidelines.

Mysql


view files and logs from admin menu

make new commands to view logs, users.json and other json files to avoid doing it manually through anydesk

accidentally closed the wrong one mb


Remotecv fails when activate sentry

remotecv_1       | DEBUG:raven.base.Client:Configuring Raven for host: <raven.conf.remote.RemoteConfig object at 0x7fa9bb1c4e50>
remotecv_1       | ERROR:sentry.errors.serializer:'Requirement' object has no attribute 'name'
remotecv_1       | Traceback (most recent call last):
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/raven/utils/serializer/manager.py", line 76, in transform
remotecv_1       |     return repr(value)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2829, in __repr__
remotecv_1       |     def __repr__(self): return "Requirement.parse(%r)" % str(self)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 110, in __str__
remotecv_1       |     parts = [self.name]
remotecv_1       | AttributeError: 'Requirement' object has no attribute 'name'
remotecv_1       | DEBUG:raven.base.Client:Sending message of length 2842 to http://sentry3.apsl.net/api/10/store/
remotecv_1       | Traceback (most recent call last):
remotecv_1       |   File "/usr/local/bin/remotecv", line 11, in <module>
remotecv_1       |     sys.exit(main())
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/remotecv/worker.py", line 95, in main
remotecv_1       |     config.error_handler = ErrorHandler(arguments.sentry_url)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/remotecv/error_handler.py", line 17, in __init__
remotecv_1       |     'modules': self.get_modules()
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/remotecv/error_handler.py", line 26, in get_modules
remotecv_1       |     res_mod = pkg_resources.get_distribution(module)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 533, in get_distribution
remotecv_1       |     dist = Requirement.parse(dist)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2833, in parse
remotecv_1       |     req, = parse_requirements(s)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2781, in parse_requirements
remotecv_1       |     yield Requirement(line)
remotecv_1       |   File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2790, in __init__
remotecv_1       |     raise RequirementParseError(str(e))
remotecv_1       | pkg_resources.RequirementParseError: Invalid requirement, parse error at "'_LWPCook'"

Maybe related: https://github.com/getsentry/sentry/issues/2784

probably related to this https://github.com/pypa/pip/issues/3681 and Debian system python packages named with leading _ chars.

Thank you @kkopachev , I will apply the fix when fixed thumbor be released.

It should be fixed in the new release.
We need to test it and close

Works for thumbor, but not for remotecv.

Fixed and merged 6.1.5


Fix IOSimPOR test failure

we were missing updating the non-dependencies in the case where the thread is not concurrent. The thread is not concurrent so it makes sense to not discover any races but it still make sense to discover any non-dependencies to make sure we don't forget to include them as per our counterexample in #154 .

Thank you @coot ! Yes you are right


[SPARK-11787] [SQL] [FOLLOW-UP] Cleanup for this patch.

This mainly moves SqlNewHadoopRDD to the sql package. There is some state that is
shared between core and I've left that in core. This allows some other associated
minor cleanup.

Test build #46353 has started for PR 9845 at commit cb3acbe.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46366/
Test FAILed.

test this please

Test build #46353 has finished for PR 9845 at commit cb3acbe.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46353/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46381/
Test FAILed.

Seems there are a few legitimate failures.

Test build #46432 has started for PR 9845 at commit b7b319c.

Could you put SPARK-11883 in the title?

test this please

Run 46432 looks slow.

Test build #46450 has started for PR 9845 at commit b7b319c.

Test build #46432 has finished for PR 9845 at commit b7b319c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46432/
Test PASSed.

Thanks - I'm merging this.

Test build #46450 has finished for PR 9845 at commit b7b319c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46450/
Test PASSed.

Merged build finished. Test PASSed.


How to add PUG and SCSS support to the Zero-config Prototyping setup?

What problem does this feature solve?
I am using vue serve for fast prototyping and I would like to use PUG and SCSS in my templates. So, I added the relevant npm packages to the global package.json for @vue/cli-service-global. This works just fine for now, but when I update to a new version of my changes are overwritten.
Hence the question: how can I add PUG and SCSS to vue serve, so that it will stick through updates?
I love the zero-config feature :)
Thanks.
What does the proposed API look like?
I don't have a proposal other than adding to the package.json for @vue/cli-service-global.

You can just use a local package.json and install those deps locally.

Fantastic :) Thanks.


Fix projection and filtering test failures

It seems like the vectorized-read branch is in need of a rebase with master which likely is also the cause behind remaining test failures. I will look into doing either a git rebase or git merge.


pull request for e2e test at 12/02/2016 20:56:09

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Video served by Ci isn't web ready

(This is looking at how the system works after https://github.com/WGBH/stock-sales-2/pull/124, which we might go ahead and merge.)
@Muraszko: Are we expecting the stocksales video to be transcoded to a usable format by Ci? That hasn't happened. At first I thought the problem might have been the MIME type, but there isn't a difference between AAPB, which works, and stocksales, which doesn't: They both have
Content-Type: application/octet-stream

but the content delivered is different:
[stock-sales-2]$ ffprobe /tmp/stocksales.video
...
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/stocksales.video':
  Metadata:
    major_brand     : qt
    minor_version   : 537199360
    compatible_brands: qt
    creation_time   : 2007-11-29 22:09:31
  Duration: 00:00:08.01, start: 0.000000, bitrate: 50403 kb/s
    Stream #0:0(eng): Video: mjpeg (mjpa / 0x61706A6D), yuvj422p(pc, bt470bg/unknown/unknown), 720x480 [SAR 72:72 DAR 3:2], 50401 kb/s, 29.97 fps, 29.97 tbr, 2997 tbn, 2997 tbc (default)
    Metadata:
      creation_time   : 2007-11-29 22:09:31
      handler_name    : Apple Alias Data Handler
      encoder         : Motion JPEG A
[stock-sales-2]$ ffprobe /tmp/aapb.video
...
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/aapb.video':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isom
    creation_time   : 2014-11-24 15:16:14
  Duration: 00:29:13.26, start: 0.000000, bitrate: 839 kb/s
    Stream #0:0(eng): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv), 480x360 [SAR 1:1 DAR 4:3], 710 kb/s, 29.97 fps, 29.97 tbr, 30k tbn, 59.94 tbc (default)
    Metadata:
      creation_time   : 2014-11-24 15:16:14
      handler_name    : MP4 Video Media Handler
      encoder         : AVC Coding
    Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 125 kb/s (default)
    Metadata:
      creation_time   : 2014-11-24 15:16:14
      handler_name    : MP4 Sound Media Handler

Talked with @Muraszko : we will just serve the stable URL proxies.


Caliper generates reports of TPS issues encountered!!!  6Tps?

Caliper generates reports of TPS issues encountered
Pressure test 1000 trades 100tps
The first problem arose when the transaction was sent
Below the figure is the generated TPS report

The sync-request function is introduced in sending transactions
The success of the transaction is shown in the figure below.
{ code: '0000',
msg: 'exec successfully',
txid: '74ee9d9890ae45d687ac58cad26d07fb' }

Use the function request-promise introduced by asynchronous sending transactions
The blockchain network could not receive information if the transaction failed, as shown in the figure

Here is the TPS I tested manually

How to better position the way of the problem!!!
I think it's because the synchronization function affects TPS

@zsh122958 I think we'll need more context. Especially about your user test module, since it can affect the precision of scheduling, and it's written by you :)

@aklenik
This is my test configuration file

invokeSmartContract Send a deal

@zsh122958 As I see, you wrote your own adapter to support a new platform. In that case, most of the code that is running is your own code. The critical path is the following for Caliper:
rate controller => user test module => invokeSmartContract => rate controller => ...
You use 5 client processes to generate a 200TPS workload, which means 40TPS per client process. This means that the rate controller code needs to be executed at least every 24ms to keep this pace. If you use more client, then this number can be higher (20 client => 10 TPS per client => 100ms duration between rate controller calls).
General advice: don't use sync calls in this path. I think line 54 is your problem. It blocks the event loop of Node.js so the rate controller is not called quickly enough. You should use async calls instead (the code will hardly change with the async/await pattern).

Thank you very much!
I'm going to do it asynchronously.
This is the report graph received.

This is something that bothers me a lot, or is there a better way? I'm trying to locate the TPS problem

In the underlying database of blockchain, 5,000 pieces of data are received.

@zsh122958 hello, now your tps result seems very good, could you advice me how you build your network? what's your configuration? what block chain you test? fabirc?

@shiningfrog
How are you
We're testing our own blockchain
There are still some problems with the test results at present, if the test is successful later.
We can communicate with each other.

@zsh122958 ok, thank you! by the way, could you give some advice in how to improve the tps first? my tps is only 20+ in caliper(open.js).

@zsh122958 ， the result shows the backend blockchain system throughput equals to the successful transactions' number. It is caused by original bug, and was fixed by  PR #274 .  You can use the newest version test it again.

@shiningfrog
I used synchronous transaction before, resulting in low Tps.
Try launching multiple local clients.

@zsh122958 As @panyu4 suggested, try rebasing your code to the up-to-date Caliper version, it had some bugs fixed recently. It shouldn't affect your adapter code.

@aklenik
This is the latest version of my use of caliper.
Asynchronous commit is currently used.
The operation is as follows:

info: [bench-flow.js]:
r.create.max:<PHONE_NUMBER>.142
r.create.min:<PHONE_NUMBER>.155
r.final.max:<PHONE_NUMBER>.145
r.final.min:<PHONE_NUMBER>.087

@zsh122958 Can you share the entire code file of your adapter (as GitHub gist)? The TPS is still shady in your report.

Relating to a custom adapter implementation, closing it.


feat: s2fft wigner matrices

I copied some unreleased code from s2fft (only temporary, I opened an issue there) to test the recurrence building of the Wigner D-matrices. I did a modification so that beta in their utils.rotation.generate_rotate_dls can be non-static.
Compilation is orders of magnitude faster:

8 seconds for (new)
from jaxoplanet.experimental.starry.s2fft_rotation import compute_rotation_matrices as R1

deg = 20
R = R1(deg, 0.0, 1.0, 0.0, 1.0)

3 minutes for (current)
from jaxoplanet.experimental.starry.rotation import compute_rotation_matrices as R2

R = R2(deg, 0.0, 1.0, 0.0, 1.0)

Of course this is preliminary and should be tested more extensively. Just a note that for spherical harmonics with a degreeL, the output of s2fft.utils.rotation.generate_rotate_dls is (L, 2*L+1, 2*L+1) (whereas we currently have a list of matrices with different shapes [(1,), (3,3), (5,5), ..., (2*L+1, 2*L+1)].
To exploit that, I tried to pad and unpad the Ylm to perform actual matrix multiplications. It doesn't seems to make things faster, which isn't that surprising. Anyway I'll push that bit in the Ylm class in case it's useful.
Looking forward doing more testings!

This is great @lgrcia!! I'll take a closer look later.

I did a modification so that beta in their utils.rotation.generate_rotate_dls can be non-static.

Is this something where you could contribute upstream or is it easier to keep it local?

I'll open an issue to discuss that there! Just to be sure about the motives behind the static beta.

Just to keep a reference somewhere, here is the version with the padded Ylm:
import jax
from jaxoplanet.experimental.starry import Ylm, rotation
import numpy as np
import jax.numpy as jnp

deg = 10
y = Ylm.from_dense(np.hstack([1, np.random.rand((deg + 1) ** 2 - 1)]))

def dot_rotation_matrix2(ydeg, x, y, z, theta):
    rotation_matrices = rotation.compute_rotation_matrices_s2fft(ydeg, x, y, z, theta)

    def dot(y_padded):
        padded_y = jnp.einsum("ij,ijk->ik", y_padded, rotation_matrices)
        return padded_y

    return dot

inc, obl = 0.5, 0.8
values = rotation.right_project_axis_angle(inc, obl, 0.0, 0.0)
f = jax.jit(dot_rotation_matrix2(deg, *values))
rotated_y = Ylm.from_dense_pad(f(y.to_dense_pad())).todense()

This is not faster than working with a non-homogeneous set of rotation matrices.

Based on the answer from @CosmoMatt in s2fft's issue #191, I tried the following implementation based on equation 8 of this paper:
from s2fft.utils.rotation import generate_rotate_dls
import jax.numpy as jnp

def new_dls(deg):
    delta = generate_rotate_dls(deg, jnp.pi / 2)
    idxs = jnp.indices(delta[0].shape)
    i = idxs[1][0] - deg + 1
    inm = 1j ** (idxs[1] - idxs[0])

    def impl(beta):
        sum_term = jnp.einsum("nij,nik,i->njk", delta, delta, jnp.exp(1j * i * beta))
        m = sum_term * inm
        return m.real

    return impl

which seems correct and passes all sort of tests with different degrees and $\beta$. However the performance I get is less that what I would have expected. The original generate_rotate_dls gives
import jax
from functools import partial

deg = 20
beta = 1.254
betas = jnp.linspace(0, 2 * jnp.pi, 4000)

f = jax.jit(jax.vmap(partial(generate_rotate_dls, deg)))
%timeit jax.block_until_ready(f(betas))

257 ms ± 1.57 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

whereas the version based on a single call of generate_rotate_dls gives
f = jax.jit(jax.vmap(new_dls(deg)))
%timeit jax.block_until_ready(f(betas))

366 ms ± 6 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

@dfm, @CosmoMatt, do you have any intuition why the vmap over $\beta$ in generate_rotate_dls still provides very good performance compared to the implementation I tested? (which might involve lots of consuming matrices multiplications at the end). I would have expected the recursive construction of the dls to be expensive. I might be missing some jax behavior here.

Hi @lgrcia, sorry I couldn't look at this sooner. Unfortunately, I can't see any obvious reason why the three term einsum in impl should be slower than the full recursion. I wonder if this may be a scaling issue that I overlooked in my previous response here.

The brute force approach requires O(L^3) per beta for a full complexity of O(beta * L^3) to compute all elements.

The FFT approach for each beta requires computing all el, m, n entries which each involve a summation of length L with complexity O(L). So the complexity for the FFT approach would presumably be O(beta * L^4).

I may be missing something here though, perhaps @jasonmcewen has a better answer here.

Thanks a lot for your answer @CosmoMatt! That is a really interesting avenue to consider anyway!

Superseded by #212


Collapsed reply threads, Global Threads & In Channel experience UI implementation

Summary
Implements Collapsed Reply Threads UI
Ticket Link
MM-29106, MM-34847, MM-34843, MM-34846
Checklist

[x] Global Threads
[x] In Channel Experience
[x] Includes text changes and localization file updates
[ ] New messages line in threads

Device Information
This PR was tested on: iPhone 12 (iOS 14.5, Simulator) & Pixel 2 (Android 11, Emulator)
Screenshots

Release Note
Added support for collapsed reply threads on mobile.

This PR is not even close to being reviewable. I'll ping when its ready for review.

/update-branch

/update-branch

/update-branch

/update-branch

Error trying to update the PR.
Please do it manually.

/update-branch

Building app in separate branch.

/update-branch

Building app in separate branch.

/update-branch

Error trying to update the PR.
Please do it manually.

/update-branch

/update-branch

/update-branch

/update-branch

/update-branch

/update-branch

Building app in separate branch.

Thanks @anurag6713
I'm seeing the same crash as Matt.
For me, it happened when switching teams while on global threads after scroll bar got switched to left. I don't have steps on how to repro the scrollbar issue, it is not reproducing consistently.

@anurag6713 I created a follow-up ticket for the minor UI polish items: https://mattermost.atlassian.net/browse/MM-36852

Enter to see the threads, there are X amount showed in the hamburger menu & the sidebar item, go to unreads, mark them all as read. unreads indicator is showing and hamburger menu keeps the same number you had before.

Also seeing the same issue as described here https://community.mattermost.com/core/pl/uz9wb8j1qjdc7eiyttk6q8h41o
Let me know if you want to take another look before I start the review process.

Threads view being displayed on the device, go to webapp and disable.
two issues: React trying to update state on an unmounted component and the bigger one is a crash

removing myself as a reviewer from the time being until this issues are addresssed.
Btw Miguel is out until August, please try and not assign any reviews to him.

/update-branch

/update-branch

Building app in separate branch.

@enahum please help prioritize your review here as you can, thanks!

/update-branch

/update-branch

Building app in separate branch.

/update-branch

Building app in separate branch.

Thanks @anurag6713
Switching teams crash is resolved for me.
Seeing few issues

"No followed threads" screen was presented at least once, despite having multiple threads
Font theme is off for global threads screen when switching teams while viewing global threads on both teams

@enahum if you can help with a review today that would be much appreciated!

I'm approving this knowing that we have a few other follow-up tickets to resolve some of the other UI tweaks/improvements

@enahum if you can help with a review today that would be much appreciated!

@esethna you are asking me to review this PR, but this PR does not tell the entire story of the feature. is there another PR that I need to review first?

@enahum Ah, here's the other: https://github.com/mattermost/mattermost-mobile/pull/5175

/update-branch

/update-branch

Building app in separate branch.

@anurag6713 Is this ticket MM-36852 also addressed here or in a separate PR? Thanks.

@anurag6713 Is this ticket MM-36852 also addressed here or in a separate PR? Thanks.

Yes @jgilliam17

/update-branch

/update-branch

/update-branch

/update-branch

Building app in separate branch.

@enahum @jgilliam17 please help with review here :)

Hello @anurag6713 (tested using test app found here)
I am seeing few issue with following a thread, thread you have not participated/followed before

After following a thread, my avatar was added to root post footer

https://user-images.githubusercontent.com/52937121/126003980-5830b9ac-000c-493f-8310-ebbdc3873996.mov

When following a single post without any replies, some random avatars are added to the footer

https://user-images.githubusercontent.com/52937121/126004147-3a67606d-c6ca-4f33-9d94-d6febafc8f10.MOV

Building app in separate branch.

/update-branch

Building app in separate branch.

Failed retrieving build links. @mattermost/core-build-engineers have been notified. Error:
503:

@enahum @anurag6713 I think you guys have this covered but if you can please help rally reviews so we get CRT onto master for v1.46, then cut a beta
cc// @amyblais

Building app in separate branch.

/update-branch

/update-branch


Feature: Searching a sensor easely with any part of its name

Is your feature request related to a problem? Please describe.
When I'm searching a sensor, I Have to write the beginning of the sensor name to find it.
Describe the solution you'd like
When I'm searching a sensor, I would like to find it by writing just a part of its name
Additional context

Related to #567

Blocked by #1029, #1030 and #1031


HP server hard drive and network cannot be displayed and cannot be accessed anywhere

HP server hard drive and network cannot be displayed and cannot be accessed anywhere。

Hi @dl1021
I will try to have a look. In the mean time, could you run the exporter with the -verbose flag and send me the log output when you try to scrape the machine?

For the network part. I checked some Gen9 and Gen10 machines, and information about the network is simply not available via the Redfish API. On Gen11 machines the information is correctly reported.
For the storage part. This is working on all my machines, so I need some debug information from you, starting with the information requested in the previous comment.

Sorry for how to reply to your email late. There has been no time to deal with other issues recently to deal with this problem. When there is time in the future, I will provide you with the information you need here. Thank you for your reply
---Original---
From: "Martin @.>
Date: Thu, Sep 26, 2024 16:51 PM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [mrlhansen/idrac_exporter] HP server hard drive and networkcannot be displayed and cannot be accessed anywhere (Issue #99)
For the network part. I checked some Gen9 and Gen10 machines, and information about the network is simply not available via the Redfish API. On Gen11 machines the information is correctly reported.
For the storage part. This is working on all my machines, so I need some debug information from you, starting with the information requested in the previous comment.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>