Add Batch data plane commands.

Hi @xingwu1, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement. It's all electronic and will take just minutes. I promise there's no faxing. https://cla.azure.com.

TTYL, AZPRBOT;

Note, if you want to check all PEP8 violation just run:
check_style --pep8 --module batch

@troydai,
The complex logic is almost entirely executed only on the specific command that is being run. Only one regex is executed in loading the module - and that's a precompiled one.
Unless the arguments for every command are loaded when the module is loaded? I was assuming the argument loader function was only called one that specific command had been executed?

@annatisch thanks for the clarification. I'm glad to know that. However, I think you should probe what hit the performance during the loading. The batch command is two times slower than the second slowest command module in the list. It absolute time will only increase in the user environment.

@troydai,
That's for confirming that - yes I've been running it under the VS profiler, though having difficulties finding the culprit. Still investigating...

@troydai, additional - do you know what cmd I can use to specifically run and display those loading stats?

@annatisch az --debug

@troydai - thanks, I just figured that out ;)

@troydai  @derekbekoe
The latest result show the loading performance has been improved a lot
DEBUG: Loaded module 'batch' in 0.056 seconds
Consider the batch service has around 90 commands, it is quite good result.

Also, one thing we require of all New Command PRs is a dump of the -h help text. This helps us spot things like missing or illogical parameter help. Not every command is necessary--generally just the create commands.
Please add those as a comment on the PR (and omit the global arguments please).

@tjprescott,
I've generated the help text into a separate branch on my fork:
Summary Commands (includes all create commands, both custom and 'auto parsed' and a couple of others, no global params)
Full Commands (includes all commands and globals)

@annatisch is the help text updated? I started looking at it and immediately saw:
    --storage-account-id          : The resource id of the storage account to be used for auto

                                    storage account.

    --storage-account-name        : The storage account name to be used for auto storage account.

This is not consistent with the rest of the CLI. It would be called storage_account which would accept a name or id. But in the custom command it only looks like storage_account_id.
I just want to make sure before I start commenting on the help text that it's the latest.

@tjprescott,
It was generated yesterday - so while it's not 100% latest, it's pretty recent.
Also - the command arguments you mentioned there are actually from the management module which has already been merged into master. But we can update it :)
FYI @xingwu1

@tjprescott,
I change the code to use single storage account to accept both name and id scenario.

@tjprescott,
I've updated the help text based on Xing's update above and an internal review.

For az batch application create:

recommend for --allow-updates: "Specify to indicate that packages within the application may be overwritten using the same version string."  That's more in line with how the rest of the CLI documents flags.
For display-name, it might be helpful to mention what, if anything, is used if this is not specified, since it is optional. Will it just show the application-id?

For az batch application package create:

Is --version a number of version string? It might be helpful for point out. For example, IIRC Android applications have two versions: a version number that must always increase and then a version string which is for display purposes only.

For az batch certificate create:
Is there an enum for what options are allowed for --thumbprint-algorithm? If so, it would be good to use the **enum_choice_list method for that parameter so that users know which algorithms are supported. This can be used even if there isn't an enum model in the SDK to reflect on. You can use **enum_choice_list(['foo', 'doo', 'bar']) to specify a custom list and get the benefits enum_choice_list confers.

My general feedback on some of the other creates (the three or four super long ones):

It seems like there are things which are or should be enums and thus exposed as choice lists (for example, os-family).
in general, where there is a parameter called --{foo}-id, if that ID is an ARM resource ID, then that parameter should just be called {foo} and it should accept a name or ID.
you might be able to shorten some of the options since you have them in argument groups. For example: the Job Manager Task arguments all start with --job-manager-task. If you can remove that and not have any naming conflicts, it might be worth considering.

Do you have data from the other CLIs on what the distribution is between customers that use the "file" option to specify everything in a JSON file vice those who actually use the 30+ arguments?
To me, the sheer number of arguments possible for some of the creates is overwhelming. If you had data on which ones (if any) could be suppressed or deferred to an update step, you could remove or default them to make the usability easier. You can always add those arguments later if people are demanding them, but removing arguments later will be much harder.
@johanste do you have thoughts/advice on this?

@tjprescott
Here is summary of answer to your questions:

--allow-updates: we don't want to change the description to "specify to ...", this string is directly copied from python SDK and come from swagger spec. We removed the "specify to ..." string from a property of swagger spec since C#/Java SDK will automatic add "Gets or sets... " to the beginning of the property title string. Right now, the properties title in our swagger spec all starts with just noun instead of verb.

"dispaly-name" is just a FYI string, if you don't specify it, it just return none.

--version is like a id, it can be anything string (not necessary as version). This is bad naming of our swagger spec (the root cause is our RP API). We don't want to do anything from our cli unless the RP side change the string.

we will add the enum_choice_list to "thumbprint-algorithm"

we will add the enum_choice_list(Type) to possible enum parameters, also fix the os-family list

The only string fit into ARM id category is "storage-account-id", which I already changed to "storage-account" parameter.

we only add prefix to parameter when we find there are conflict between 2 parameter. For example, both "job-manager-task" and "job-prepartion-task" have property named "id", to flatten them in the command line parameter, we rename them to "job-manager-task-id" and "job-prepartion-task-id", otherwise, the parameter names are exactly same as properties name.

we will do more investigate to reduce the level of flatten to reduce the parameter number.

@tjprescott, @troydai
We've just finished an internal review of the commands and help documentation and I have updated the outputs here:
Summary Commands (includes all create commands, both custom and 'auto parsed' and a couple of others, no global params)
Full Commands (includes all commands, group headings and globals parameters)
The commands have reduced quite significantly - though still quite numerous. Let us know what you think. We've addressed the enum options (and removed thumbprint-algorithm), and prefixed more commands for clarification. We've reworded quite a lot of the help text to be more informative (e.g. correct use of Boolean flags).
FYI @itowlson

@tjprescott
We reduced more parameters and add the VM image completer.

@troydai Could you review the change and sign off it if you feel good with the change?

@troydai - would be great if you could take a look at the changes so we can get this merged today :)

I'm taking another look.

Thanks everybody! Great to see this merged!

Thanks guys!!

Thanks!!!


Chrome - Violation Added non-passive event listener...

I am seeing the following error in Chrome with Mediaelement version 2.4.5
mediaelement-and-player.js:1792 [Violation] Added non-passive event listener to a scroll-blocking 'touchstart' event. Consider marking event handler as 'passive' to make the page more responsive.

If you can create a PR based on https://github.com/WICG/EventListenerOptions/blob/gh-pages/explainer.md I'll be happy to review it

Please download the master branch and confirm this error disappear. Also, please star the project to continue supporting it. Thanks

Hello, I have download the latest mediaelement-master-v<IP_ADDRESS> and am no longer seeing this issue.
Thanks!


Body sent via POST is not retrievable

Hello,
Starting a project with current 2.0.2, I'm facing an issue when trying to send POST requests.
Basically the retrieved body ends up being empty, which causes fatal errors.
I've identified the issue to be coming from WoohooLabs\Yin\JsonApi\Request\Request::getParsedBody, I'll post a PR shortly.

Here's the PR https://github.com/woohoolabs/yin/pull/65

Fixed.


metasv error when running local assembly

Hi Brad,
I found a problem with metaSV when running the local assembly - Spades.
It seems a similar error to: https://github.com/chapmanb/bcbio-nextgen/issues/1075, but I'm not sure about what is causing the problem.
Please find the error copied below.
Thanks,
amaia
INFO 2015-12-16 10:43:31,315 metasv.run_spades    5176 intervals selected
INFO 2015-12-16 10:43:31,315 metasv.run_spades    22 intervals ignored
INFO 2015-12-16 10:43:32,807 run_spades_single-<Process(PoolWorker-2, started daemon)> Processing interval 22   16054689        16054690        eyJOVU1fU1ZNRVRIT0RTIjogMSwgIkJEX1NDT1JFIjogMzUuMCwgIkJEX09SSTIiOiAiMTQrMTMtIiwgIkJEX1BPUzEiOiAxNjA1NDY4OCwgIkJEX1BPUzIiOiAxNjA1NDgyOSwgIkJEX09SSTEiOiAiMTQrMTMtIiwgIkJEX0NIUjEiOiAiMjIiLCAiU09VUkNFUyI6ICIyMi0xNjA1NDY4OS0xNjA1NDY4OS0xMjQtQnJlYWtEYW5jZXIiLCAiQkRfQ0hSMiI6ICIyMiIsICJOVU1fU1ZUT09MUyI6IDEsICJCRF9TVVBQT1JUSU5HX1JFQURfUEFJUlMiOiA0fQ==,INS,124,RP   1       .
INFO 2015-12-16 10:43:32,808 extract_read_pairs-<Process(PoolWorker-2, started daemon)> Extracting reads from /data/corpora/MPI_workspace/lag/workspaces/lg-ngs/working//bam_sort/DYS14587.final.sorted.bam for region 22:16054689-16054690 with padding 500 using functions ['all_pair', 'non_perfect']
ERROR 2015-12-16 10:43:32,909 run_spades_single-<Process(PoolWorker-2, started daemon)> Caught exception in worker thread
Traceback (most recent call last):
  File "/home/amacar/.local/lib/python2.7/site-packages/metasv/run_spades.py", line 68, in run_spades_single
    max_read_pairs=max_read_pairs, sv_type=sv_type)
  File "/home/amacar/.local/lib/python2.7/site-packages/metasv/extract_pairs.py", line 93, in extract_read_pairs
    aln_list = [aln for aln in bam.fetch(chr_name, start=chr_start, end=chr_end) if not aln.is_secondary]
  File "csamtools.pyx", line 1059, in pysam.csamtools.Samfile.fetch (pysam/csamtools.c:12490)
  File "csamtools.pyx", line 989, in pysam.csamtools.Samfile._parseRegion (pysam/csamtools.c:11668)
  File "csamtools.pyx", line 923, in pysam.csamtools.Samfile.gettid (pysam/csamtools.c:10827)
  File "csamtools.pyx", line 57, in pysam.csamtools._force_bytes (pysam/csamtools.c:3393)
TypeError: Expected bytes, got unicode
INFO 2015-12-16 10:43:33,066 metasv.run_spades    Merging the contigs from []
Traceback (most recent call last):
  File "/data/corpora/MPI_workspace/lag/workspaces/lg-ngs/working/programs/metasv-0.4/scripts/run_metasv.py", line 136, in <module>
    sys.exit(run_metasv(args))
  File "/home/amacar/.local/lib/python2.7/site-packages/metasv/main.py", line 307, in run_metasv
    assembly_max_tools=args.assembly_max_tools)
  File "/home/amacar/.local/lib/python2.7/site-packages/metasv/run_spades.py", line 204, in run_spades_parallel
    for line in fileinput.input(assembly_fastas):
  File "/usr/lib64/python2.7/fileinput.py", line 253, in next
    line = self.readline()
  File "/usr/lib64/python2.7/fileinput.py", line 346, in readline
    self._buffer = self._file.readlines(self._bufsize)

Thanks @amaiacc for filing this issue. Which version of pysam are you using? Looks like @chapmanb 's fix either did not go through or was overridden accidentally.

amaia -- thanks for the report and sorry about the problem. It looks like I missed a place where we needed to explicitly change the chromosome to be a string instead of unicode before feeding to pysam. I sent in a PR, and also pushed a new conda version of metasv with this fix in bioconda (https://bioconda.github.io/) so you could get it right away with:
conda install -c bioconda metasv

Thanks again for reporting this.


Restart vue-cli-service on .env file change

What problem does this feature solve?
There is no built-in way to listen for changes to .env files to trigger a reload of the dev server.
This is especially frustrating when developing withing a docker environment where npm run server is the entrypoint.
What does the proposed API look like?
vue-cli-service serve --restart-on-env=true

This is especially frustrating when developing withing a docker environment where npm run server is the entrypoint.

I don't understand that specific point.
Also, I have a hard time imagining a scenario where I have to constantly change env variables. rebooting the dev server can't be such a hassle if it's once or twice a day or so?


Fix runtime panic on key export

The key export panics on
lens keys export my_key_name --chain evmos as it is using the wrong array index to lookup the key.
panic: runtime error: index out of range [1] with length 1

Thanks so much for this PR! Sorry I'm only just getting around to merging it


Terrain shifted

I tested this on both bteairoecean and the default projection. When teleporting to 46.221099, 15.266406, the water and the roads are placed correctly, but it seems like the terrain itself is shifted. For example, in the screenshot below, the river and the road is positioned on the left in the valley in real life, but here it's placed uphill.

Another example at the same location.

I checked the dem files itself and overlayed it with the default map in osm, and it's aligned correctly, so the dem files itself are correct.

ok correct me if i'm wrong, but you're saying the river in the top picture is supposed to flow to the left of that hill and so is the road?

Yes. This is how it looks like in real life. The hill starts right at the edge of the road, like in the bottom picture on the left.

Another example.

the way the roads and rivers are generated is by estimating the height of the terrain at a given x and z (converted from the latitude and longitude from the OSM data) and placing it there. obviously that creates problems. for example, here. i'm not sure exactly what the problem is, but the mod owner (@orangeadam3) is working on a bug he calls grounding issues, and this may be covered by that, so i'll let you know when a fix for that comes out. if the problem persists afterwards, i'll see what i can do about it.


ROM/Course Expansion

Would it be possible to add an option in the program to allocate more space for larger course(larger tilemaps)? And additionally, if possible, expand the total size of the ROM?

ROM expansion already happens automatically on saving (all new course data is written to expanded ROM space, leaving all of the original data intact).
The tile map etc. size limitations are due to limits on the amount of RAM that the game allocates to those things during gameplay; expanding that wouldn't be possible without massively rewriting other game code to account for it, which isn't really feasible.

The best I can think of to improve that situation is try to reduce the memory use of the tiles, but that would take more coding that just a simple editor.

That would definitely take even more work in modifying the game's internals than simply giving the tile maps more RAM to work with. Currently the entire uncompressed tilemap is loaded into RAM all at once, which is the reason for the hard limit on space; it theoretically would be possible to totally redesign parts of the level format (and rewrite lots of the game code that deals with it) so that smaller parts of the map are loaded from the ROM on the fly during gameplay (but again, not really feasible).


Can't set colors programmatically

Hi !
I really appreciate this library. But I found something that, in my case, seems problematic.
I currently have a need to set most colors programmatically in my app, and that the case for a bottomNavBar.
The problem is, using Java (didn't try using Kotlin), though I seems to be able to set the different colors, nothing change when the view is displayed.
bellow is an example of what I tried :
 bottomNav.setFabBackgroundColor(colors.getIntPrimaryColor()); bottomNav.setNavBackgroundColor(colors.getIntPrimaryColor()); bottomNav.setSelectedColor(colors.getIntTextOnPrimary()); bottomNav.setUnSelectedColor(colors.getIntTextOnPrimary());
Is there any way to set (or change) the colors programmatically ?
If not would you be interested in implementing this ?

Yeah you are right, I have checked and selectedColor seems to work but other attributes aren't working properly. I haven't updated this library in quite a while. I will manage some time to fix it.

@EleryanYuri I have fixed your problem and some minor issues. The code is currently in this branch. You can help by verifying this.

Well, that was quick! I did not find anything wrong with the fix. Everything is working perfectly fine now.
Thanks for the fix and for your quick response.

This has been fixed in the latest release. Closing the issue.


[RFC] twister: implement simulation_exclude filter

This PR attempts to solve the dilemma when a physical board can pass a testcase but its simulator couldn't.
See:
https://github.com/zephyrproject-rtos/zephyr/blob/bd227e19cff9855355468974f1f984ed88f2cf3d/tests/kernel/timer/timer_behavior/testcase.yaml#L9-L19
and https://github.com/zephyrproject-rtos/zephyr/pull/66369#issuecomment-1849703114

I see the yaml you're editing contains:
   platform_type:
      - mcu

So it seems the test is already designed and marked as to be "mcu" specific. Maybe you could improve the handling of this type in twister, instead of adding new marking?

Maybe you could improve the handling of this type in twister, instead of adding new marking

Real boards and renode-simulated boards share the same platform_type: mcu, we will need something else to differentiate between the two

I've moved the simulation filtering to check_runnable as it seems more appropriate, another plus is that tests will be built for platforms with blocked simulator. I also noticed that the test is running and passing on both mps2_an385 & mps2_an521_ns even though they were in the platform_exclude list, and used qemu instead of renode as simulation


bug(navis): transformation by bounding box not relocating geometry to model origin

3 options exist for geometry transformation:

Navis Model Origin
By Bounding Box centre
By Project Location

The latter 2 of these options should relocate geometry relative to the transformation origin to model origin 0,0
Bounding Box transforms appear to be broken.

Closing this ticket as we are moving to Jira to reduce noise. You can access it there.


docs: fix typescript-type-graphql plugin name

fix plugin name so that we can generating type-graphql codes.

Awesome, thank you @cncolder !


still get some empty elements

Even after commit af23b50e41dae I get some empty fields.
Example:
[{'definitions': [{'examples': [],
                   'partOfSpeech': 'noun',
                   'relatedWords': [],
                   'text': ['Krismasi\xa0(n class, no plural)', 'Christmas']}],
  'etymology': 'From English Christmas.\n',
  'pronunciations': {'audio': [], 'text': []}}]

Test case:
#!/usr/bin/env python3

from pprint import pprint

from wiktionaryparser import WiktionaryParser

parser = WiktionaryParser()
parser.set_default_language('swahili')
word = parser.fetch("Krismasi")

pprint(word)

@tbm Thank you for reporting this! I haven't released a new version of the parser with recent commits so just wanted to make sure that you're running from source and not from pip because that would be outdated. Could you clone the source and run python setup.py install from there?

Yes, this is with GitHub master.

Interesting, I'll have a look

@tbm #72 was supposed to fix cases where the output contains data for the wrong language. In your case, the output seems correct since you're setting the language to Swahili. I don't think this is an issue with the parser but, let me know if you're facing trouble with other words/languages

Right, but my question/bug is that the value I get contains empty elements.  e.g.:
  'pronunciations': {'audio': [], 'text': []}}]

Why is pronunciations there when it wasn't set in the entry on Wiktionary?

@tbm the output schema is standard across all words/languages. A lot of words don't have pronunciations or related words so those values would turn up as empty objects/lists even though the keys are included in the JSON. Maybe I should add a note to the about this

Oh, ok, thanks for the clarification.  I was just surprised to see empty values.  I was expecting pronunciations to simply not exist when there's no pronunciation on Wiktionary.
Documenting this might be a good idea, thanks.


Include context menu for nemo file manager on linux

Request accessibility features for Linux users.
Context menu for Nemo File Manager
I have created the plugin ..
Here is how it looks

@donnisnoni95 It is not clear what you are asking for here..

@ramya-rao-a  I mean, please add the context menu feature on the Linux platform like the one on the Windows platform.
Where when we open the project folder in file explorer ... when we right-click ... there will also be a menu to open the current folder with visual studio code. Thank you


added techblog file

added link to the Klaytn tech blog wiki

@kjhman21 Can I merge this now? :) I added the directory and image


Should allow checkout completion even if a domain is already registered or cannot be verified

Current Problem:

If you try to checkout with a domain that has already been registered, you won't be allowed to proceed and will be give an "The domain is already registered" error. This stops anyone who wants to move their existing domain to you from proceeding with checkout.
Also if one wanted to a TLD such as .co.zw (which is not supported by the WC-Invoice check), they they get an "The domain could not be verified" error.

Proposed Solution
When a domain is entered, we should only check if it's already in the ISPConfig server. If not, we should allow the buyer to proceed with checkout. A domain that is already registered or that cannot be verified should not stop us from proceeding with checkout.

wc-invoice-pdf actually uses the wp-ispconfig3 plugin to verify the domains (through ajax).
I think I will give wp-ispconfig3 plugin an option to only check domain only against ISPConfig (hooked/unhooked)


GAViewer

Is it necessary to add something to the release notes?
Motivation for this change
This is the companion software to the book Geometric Algebra For Computer Science, An Object Oriented Approach to Geometry, published by Morgan Kaufmann Publishers.
Most of the figures in the book were generated by GAViewer, a tutorial program for geometric algebra.
They are shots of 2-D or 3-D interactive scenes, and you can increase your understanding of geometric algebra by playing around with them.
Having GAViewer installed allows you to do more, transcending the book figures:

view results of your own derivations
test correctness of formulas by trying them in various circumstances
generate personal figures for your own geometric algebra presentation (please refer properly to GAViewer if you do)

Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Is it necessary to add something to the release notes?

No, that is not required.

Closing due to inactivity from author.

Closing due to inactivity from author.


Can not find video0 under /etc/

My raspberry pi camera can not be found in this img.could someone can help me.

Dear @ZhaoXiangBox ,
You find your camera drivers under /dev/video0, not /etc/video0
Kind regards,
Rients

This issue has been automatically marked as stale because it has no recent activity. It will be closed if no further activity occurs. Thank you.


Example with next.js

Need example with next.js

Complete: https://github.com/zeit/next.js/tree/canary/examples/with-astroturf

This example is no longer available on this url ^

Example for next.js would highly be appreciated!

Here is (most likely) the example from the link above: https://github.com/shashkovdanil/next.js/tree/9f6dcae4888f48e042d82d493c405224fbe978fa/examples/with-astroturf
Here is what kind of worked for me on a clean next.js (13.4.8) project:
yarn add astroturf postcss-nested

// postcss.config.js
module.exports = {
  plugins: {
    tailwindcss: {},
    autoprefixer: {},
    'postcss-nested': {},
  },
}

// next.config.js
/** @type {import('next').NextConfig} */
const nextConfig = {
  webpack: config => {
    config.module.rules.push({
      test: /\.tsx$/,
      use: ['astroturf/loader']
    })
    return config
  }
}

module.exports = nextConfig

Unfortunately styles are not updated on hot reload. Any ideas how to fix it?


Min-max range for Turbo colormap doesn't make sense for depth images

Depth images logged as int16 currently get a way too high-max value for colormaps (Turbo only in 2D views). This makes the colormaps close to useless as they end up giving close to uniform colors.
Examples:
2D view

Same depth image backprojected with Turbo colormap

I fail to reproduce.
This is nyud, with the points invisible, and Backproject Depth turned on:

The turbo colormap works well, and the 2D view has no colormap, since we haven't gotten to that yet:

https://github.com/rerun-io/rerun/issues/1612

@emilk
I'll get an easier repro for you asap but in the mean time, has something changed so we don't use turbo by default for depth images? We set turbo as default for depth images here:

https://github.com/rerun-io/rerun/issues/351

We seem to only use it onlyfor float depth images, not integer depth images. I can make a fix for that.

For repro, just try:

https://github.com/rerun-io/rerun/pull/1538

arkitscenes have somehow been fixed by my recent PRs:

I'll merge main into the branch

arkitscenes have somehow been fixed by my recent PRs:

Fantastic! Best kind of fix =)


[BUG] Retrieve taking 30 minutes for 1679 assets

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
mcdev retrieve on a Business Unit took over 30 minutes for 1679 assets to be downloaded. I'm sure it didn't take this long in the previous version of MCDevTools (v6).

Expected Behavior
Previously I remember it taking only a minute or two. Might want to take a look into this, whether this is normal.
Steps To Reproduce

Go to '...'
Click on '....'
Run '...'
See error...

Version
7.0.4
Environment

OS:
Node:
npm:

Participation

[ ] I am willing to submit a pull request for this issue.

Additional comments
No response

could it be that "previously" you didnt have 1600 emails in content builder on that BU?
Looking at your log, the other types were processed as per expectation but if you hit the API this much SFMC sometimes applies throttling for your IP... I'm assuming this might have happened on top

recent example from myself in which i downloaded 958 assets in under 2 minutes:

pretty sure that you had internet / throttling issues


Date and Day repeats in the April Month of the 2023

In April 2023 for the New Zealand time zone, I'm observing that Date 2 April and Sunday are rendered twice in a row, because of which the whole UI is getting disturbed Can anyone please help me out with this asap?
Please find the attachment here
Timezone is set to Wellington, New Zealand

My local timezone

I have tried switching multiple time zone i.e. NewYork USA and Perth Australia and my local time zone ie. India but my not facing such issues there I guess this issue is occurring in some timezone that needs to be checked.

Hello @howljs can you please help me with this as I'm still facing this issue also, let me know if you want any details form my side thanks.

@kaushal-technostacks I am reviewing and fixing some other issues before releasing the new update

@kaushal-technostacks I published a new version. Thanks for you report


feat: updated clipboard design

Updates

closes #5
feat: updated clipboard design
feat: redesigned updates page
chore: commented about page code

Screenshots
Clipboard Design

Updates Page


Basin selection during chi analysis

lsdviztools version: I am using the docker container described in the readme of this repo.
Python version: 3.8
Operating System: mac os

Description
I am trying to run chi analysis on several basins and am trying to select certain basins based on a junction number.  I selected the outlet junctions using the AllBasinsInfo in QGIS and put the numbers into a .txt file and ran the following code.
What I Did
First I ran the following code using a Junctions.txt with the junction numbers.
lsdtt_parameters = {
                    "print_chi_data_maps" : "true",
                    "BaselevelJunctions_file": "Junctions_maacama.txt",
                    "estimate_best_fit_movern_no_bootstrap": "true"
                   }

lsdtt_drive = lsdmw.lsdtt_driver(command_line_tool = "lsdtt-chi-mapping", #default is lsdtt-basic-metrics
                                 read_prefix = "Maacama_UTM",
                                 write_prefix= "Maacama_UTM",
                                 read_path = "./",
                                 write_path = "./",
                                 parameter_dictionary=lsdtt_parameters)
lsdtt_drive.print_parameters()

lsdtt_drive.run_lsdtt_command_line_tool()

This runs the analysis but does not remove any of the unwanted basins.
The channel head file is null.
Getting sources from a threshold of 1000 pixels.
The number of sources is: 578
I am now going to extract some basins for you.
No baselevel junctions file found. I am going to use algorithms to extract basins.

I need to check your baselevel junctions file, to see if it is in the correct path.
The string to check is: NULL
I am going to select basins for you using an algorithm.

So looking at the LSDTopoTools repo I found info on the BaselevelJunctions file method: "An old method. You should use get_basins_from_outlets: true and basin_outlet_csv instead."
So I reran using this, with the lat, lon positions and junction numbers saved in a csv (outlet.csv):
lsdtt_parameters = {
                    "print_chi_data_maps" : "true",
                    "get_basins_from_outlets":"true",
                    "basin_outlet_csv":"outlets.csv",
                    "estimate_best_fit_movern_no_bootstrap": "true"
                   }

lsdtt_drive = lsdmw.lsdtt_driver(command_line_tool = "lsdtt-chi-mapping", #default is lsdtt-basic-metrics
                                 read_prefix = "Maacama_UTM",
                                 write_prefix= "Maacama_UTM",
                                 read_path = "./",
                                 write_path = "./",
                                 parameter_dictionary=lsdtt_parameters)
lsdtt_drive.print_parameters()

lsdtt_drive.run_lsdtt_command_line_tool()

and this fails with:
To reiterate, there is no base level junction file. I am going to select basins for you using an algorithm.
I am getting your basins from a list of nodes.
The basin file is: ./outlets.csv
I am creating a csv object from a raster info object and a csv name.
I have opened the csv file.
This header is: outlet_latitude
This header is: outlet_longitude
This header is: outlet_junction

and
I did not find any valid basins from your outlet.

In the csv file the column headers must include "latitude" and "longitude" (so no "outlet_"). Other tips: 1) in the DEM if there are no junctions below your selected point the basin extraction might fail. So make sure you are upstream of at least 1 junction 2) Any basins with pixels along an edge will be removed, so make sure you have complete basins 3) You can reduce the threshold contributing pixels so there are many junctions, this means your selected point will be close to the nearest junction. Let me know if this fixes the problem.

I have updated the docker container with newer versions and have tested this notebook against it: https://github.com/LSDtopotools/lsdtt_notebooks/blob/master/lsdtopotools/basin_selection.ipynb

Yes, thanks, that worked!


dropdown to filter Projects

Description
I guess currently we're having tags in projects section, Which is not looking good in smaller screens
Hence, a dropdown is necessary for filtering the projects technology
@tobySolutions , Please assign this task to me :)
Screenshots

All yours @MadhuSaini22!!!!


Make computeGeometry public

See #5

Is there anything against this change? @jeremyz

I would prefer to set it protected in Button and Menu as it should be ;)
I like to keep the API as closed as possible to avoid wrong usage or maintenance issues.
I don't get what your use case would be ?

In my box widget, I calculate the size based on the size of the children. And because the size of a label is calculated in computeGeometry, it must be calculated before my box widget, which is currently not the behavior. So I would call computeGeometry of the children in computeGeometry of my box method. And because I got a different package, I can not access the computeGeometry of the children

sure ... Menu works because it's in the same package, I always forget about that java thing.
when you have a nice and working Box widget, feel free to open a PR ;)

I will! I have already a very basic TextField.
Can you add your formatting settings to the repo, so I don't have to make the formatting beforehand? This would be really nice

For the taintParent, how can I change it now? It's protected and has no setter or getter. So I have to make a subclass or what's you thought with this

haaa you want to actually use it, I thought we were just pretending ;) pushed.
I don't have any formatting settings, just vim.

Yes I wanna use it :D I wanna use everything for which I made a PR
Oh crap, you don't use an IDE? Isn't that annoying?

nope it isn't, I have autocompletion, that's enough for me,
and by the years, I can't type code with anything else but vim,
I'm so used to it, and efficient enough with code manipulation.

taintParent works by the way only, if I override
@Override public void taint()
    {
        children.forEach( c -> c.taint() );
    }

from Assembly with the original from Element:
public void taint()
    {
        this.tainted = true;
        if (parent != null && taintParent) parent.taint();
    }

Else I get this beautiful Stackoverflow:
Exception in thread "main" com.badlogic.gdx.utils.GdxRuntimeException: java.lang.StackOverflowError
	at com.badlogic.gdx.backends.lwjgl3.Lwjgl3Application.<init>(Lwjgl3Application.java:117)
	at de.nilsim.collapse.desktop.DesktopLauncher.main(DesktopLauncher.java:10)
Caused by: java.lang.StackOverflowError
	at ch.asynk.gdx.boardgame.ui.Assembly.taint(Assembly.java:50)
	at ch.asynk.gdx.boardgame.ui.Element.taint(Element.java:65)
	at ch.asynk.gdx.boardgame.ui.Assembly.lambda$taint$0(Assembly.java:50)
	at java.base/java.lang.Iterable.forEach(Iterable.java:75)
	at ch.asynk.gdx.boardgame.ui.Assembly.taint(Assembly.java:50)

By the way, why is the taint() Method overridden in Assembly? I don't see any change in the test subproject with the default from Element

look at my coment in  #12. it's for window resizing.
I've just set a litte test, that taintParent stuff works if you set it properly, enable it only in the Elements that you will change and that are not owned by Root(Assembly).

http://cgit.asynk.ch/public/taintParent.patch

My purpose was to set taintParent on the children of my Box which is an assembly. Maybe a parameter taintChildren:boolean for the assembly taint method is a good way to call parent.taint(false). Or two seperate methods taint() which has the default behavior like element and taintChildren() which iterats over the children and calls taint()

yep, Assembly was not meant to be used as a building peace for widgets, but I can see why you're using it as such. I like your taintChildren idea. In it is !


Add a "max" button

Hi guys,
What do you think about adding a "max" button to the LUM wallet?

Hello @krutouchel,
That looks a good idea. Thank you for suggesting!
We will investigate it and come back later with a timeframe.
Regards


Minor: Upgrade solr and httpcomponents version

@byxorna @Primer42

What do we get out of this upgrade? Any specific features we want?

no idea what the new features are. Nothing more than upgrading the deps and ensure we can continue building.


Variables set in one task get prefixed?

I'm using a powershell script to set output variables in one task as outlined here: https://docs.microsoft.com/en-us/azure/devops/pipelines/process/variables?view=azure-devops&tabs=classic%2Cpowershell#set-in-script
However, when I want to use them from the environment variables in the next task, they always get prefixed with either "POWERSHELL1_", or if I specify a reference name for the output, with that name. In the documentation example above, you simply use $env:SAUCE to read the variable without any prefix.
Did I miss anything here?
I set them like this:
$json=Get-Content $jsonPath | ConvertFrom-Json
$json `
    | Get-Member -type NoteProperty `
    | ForEach-Object {
        $o=$json."$($_.Name)"
        "##vso[task.setvariable variable=$($_.Name);isOutput=true$(if ($o.sensitive -eq "True") {";issecret=true"})]$($o.value)"
    }

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: dd7e0bd3-1f7d-d7b6-cc72-5ef63c31b46a
Version Independent ID: dae87abd-b73d-9120-bcdb-6097d4b40f2a
Content: Variables - Azure Pipelines
Content Source: docs/pipelines/process/variables.md
Product: devops
Technology: devops-cicd
GitHub Login: @juliakm
Microsoft Alias: jukullam

if you don't want the variables to be prefixed with the step name, drop the isOutput=true, as it shows in the first example at https://docs.microsoft.com/en-us/azure/devops/pipelines/process/variables?view=azure-devops&tabs=yaml%2Cpowershell#set-variables-in-scripts
isOutput is only needed if you want to reference the variable in a subsequent job, not task.

thank you so much @jdkemme ! That was in fact the issue for me. I hadn't noticed that before. I set it now to false and all is good.


Change Repository Name

Purpose:

Repository name might not accurately reflect the content

coding-tips -> compsci-tips
The ideas that I'm covering are much more broad than just coding

Forgot to update references in main README

coding-tips -> compsci-tips
The ideas that I'm covering are much more broad than just coding

85444fa42d6e87e2488fe504ef13c0675e1aeca0 fixes the issue


Wip autoupdate

It's probably simpler to use the Anaconda API directly instead of using mamba, you can take inspiration from https://github.com/conda-forge/miniforge/blob/main/.github/workflows/conda_release.yml

It's probably simpler to use the Anaconda API directly instead of using mamba

I tried that in the past and it grew into a huge codebase, I want to try a very simple approach here. Maybe the previous approach was over engineered https://github.com/Quantco/.github/tree/master/workflow-templates https://github.com/Quantco/github-actions/tree/update-conda-dependencies/update-conda-dependencies

Yes, that is a bit overengineered. I would expect this to be simpler than the one I've written for the conda action. My approach would be

Write a JavaScript action that fetches the current version and writes the environment.yml
Use https://github.com/conda-forge/miniforge/blob/c62a54605a63522514effe10ccf0d6b2bb2863d2/.github/workflows/autoupdate.yml#L17-L32 to make a PR on a change.

@xhochy this seems to work and I think it's even simpler


Presents empty attribute should result 'true' for boolean attribute

Empty (but present) attribute should result in 'true' for boolean attributes. Currently I need to write:
<my:element test="true"></my:element>

Which imho should simple become:
<my:element test></my:element>

...
attribute bool test;
...

Could you add support for this?

I don't think the gain is worth the changes; it'd be a parser change to HHVM, to turn:
<foo bar />

to
<foo bar={true} />

Given that we don't actually know that 'bar' is a bool attribute until runtime (or the typechecker run), this could lead to subtle bugs, as we'd end up doing this transform for any attribute with a missing value.


[#133] Design dashboard for current metrics

design dashboard for current metrics and add user document for it

@linzs148 Please, rebase, and squash your commits
@MariamFahmy98 PTAL

@linzs148 Please, rebase, and squash your commits

I have removed the merge commit

@linzs148 Please, rebase, and squash your commits @MariamFahmy98 PTAL

I have removed the merge commit to meke it clean.

Thanks for the PR. It's good for me.

I think we need an issue for this that can be referenced in the commit message.
And, I think we need some screenshots on the issue or in the discussion thread.

@linzs148 ping ?

@linzs148 ping ?

I have related this pull request with issue [#133] and put screenshots on issue and discussion.

Could you get the feedback sorted this week, please ?

Could you get the feedback sorted this week, please ?

What does this feedback mean? Comments in this pullrequest or something else?

https://github.com/pgmoneta/pgmoneta/issues/133#issuecomment-1630773387

Add a link from the GETTING_STARTED.md to the tutorial

@linzs148 Please, get this sorted quickly

@linzs148 Please, get this sorted quickly

@jesperpedersen I have changed the commit and the workflow needs to be approved.

Rebased, and merged.
Thanks for your contribution !
Please, continue discussing what the next steps are in your forum thread.


Add more things to interview stats

Did they finish the interview
Zip
County
City
What forms did they assemble
When was the interview started
When did they reach the download page
Probably almost everything else that is anonymous

See also #556

City and county stat tracking has been added in #583. Zip and "did they finish the interview" stat tracking already exists in the interview.


Wait for ipcache propagation before starting tests

Note that this PR is based on #215 (first 8 commits) and will be rebased to master when it is merged.
Move the pause (--pause| `-p') wait for user input before policies are deleted.
Wait for ipcaches to have test pod IP->ID mappings before starting tests.
Fixes: #215
Fixes: #158

I pushed these changes to #215 instead to keep the conversation in one place.


Prevent NPE when attempt to fetch partition information fails

Changes are to prevent the NPE and provide a meaningful error message to the user when there is a failure to fetch the partition information.
NPE seen by the end user who created a Kafka topic without any partitions in a third-party managed Kafka cluster.
Caused by: java.lang.NullPointerException
        at org.apache.pinot.plugin.stream.kafka20.KafkaStreamMetadataProvider.fetchPartitionCount(KafkaStreamMetadataProvider.java:60) ~[startree-write-api-0.13.0-ST.98.3-shaded.jar:0.13.0-ST.98.3-1eb9c04b445be445d976f47c790dddaed274298d]
        at org.apache.pinot.spi.stream.StreamMetadataProvider.computePartitionGroupMetadata(StreamMetadataProvider.java:68) ~[startree-pinot-all-0.13.0-ST.98.3-jar-with-dependencies.jar:0.13.0-ST.98.3-1eb9c04b445be445d976f47c790dddaed274298d]
        at org.apache.pinot.spi.stream.PartitionGroupMetadataFetcher.call(PartitionGroupMetadataFetcher.java:70) ~[startree-pinot-all-0.13.0-ST.98.3-jar-with-dependencies.jar:0.13.0-ST.98.3-1eb9c04b445be445d976f47c790dddaed274298d]
        at org.apache.pinot.spi.stream.PartitionGroupMetadataFetcher.call(PartitionGroupMetadataFetcher.java:31) ~[startree-pinot-all-0.13.0-ST.98.3-jar-with-dependencies.jar:0.13.0-ST.98.3-1eb9c04b445be445d976f47c790dddaed274298d]
        at org.apache.pinot.spi.utils.retry.BaseRetryPolicy.attempt(BaseRetryPolicy.java:50) ~[startree-pinot-all-0.13.0-ST.98.3-jar-with-dependencies.jar:0.13.0-ST.98.3-1eb9c04b445be445d976f47c790dddaed274298d]
        at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionGroupMetadataList(PinotTableIdealStateBuilder.java:160) ~[startree-pinot-all-0.13.0-ST.98.3-jar-with-dependencies.jar:0.13.0-ST.98.3-1eb9c04b445be445d976f47c790dddaed274298d]
        ... 31 more

Notes: Unable to add a test using mocks as the class KafkaPartitionLevelConnectionHandler declares the consumer as  final within it's constructor. Additionally, the Kafka library always creates a default partition (0) when creating the Kafka topic.

Codecov Report

Merging #11769 (1c68b99) into master (13c2901) will decrease coverage by 48.70%.
Report is 4 commits behind head on master.
The diff coverage is 50.00%.

@@              Coverage Diff              @@
##             master   #11769       +/-   ##
=============================================
- Coverage     63.13%   14.43%   -48.70%
+ Complexity     1117      201      -916
=============================================
  Files          2342     2342
  Lines        125916   125918        +2
  Branches      19370    19371        +1
=============================================
- Hits          79501    18182    -61319
- Misses        40749   106194    +65445
+ Partials       5666     1542     -4124

Flag
Coverage Δ

integration
?

integration1
?

integration2
?

java-11
?

java-17
14.43% <50.00%> (-48.52%)
:arrow_down:

java-20
?

temurin
14.43% <50.00%> (-48.70%)
:arrow_down:

unittests
14.43% <50.00%> (-48.70%)
:arrow_down:

unittests1
?

unittests2
14.43% <50.00%> (-0.04%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files
Coverage Δ

...in/stream/kafka20/KafkaStreamMetadataProvider.java
44.61% <50.00%> (-0.55%)
:arrow_down:

... and 1516 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Swift Package Manager support

This pull request contains support for the newly added Swift Package Manager (SPM) support of Xcode 11.
From Xcode 11, it supports to build a library against UIKit with SPM. That means we can use it to provide an easier way to integrate our SDK into user's project. I modified some of the project files/settings to let this project compatible with SPM. There is also a new sample app target LineSDKSample(SPM) to verify the behavior when building with SPM.
Some concerns and things not contained yet:

Since the SPM now does not support building resource yet, I removed all resource related things out. For example, the LoginButton and all localization files, and the new sharing UI planned to be added in next version. It is proposed in this file, maybe we can see it next year.
Only the LineSDK target now supports SPM. Our ObjC wrapper LineSDKObjC is not yet. I wonder whether it worths or be possible to do so. Since the ObjC wrapper is also a Swift project and it should be just a subset of using Swift features, it is possible to also provide SPM support for it. However, users of this wrapper is using our SDK through Objective-C, I don't know whether users can get any benefit from SPM when using Objective-C as their language.
The SPM support from Xcode 11 would add some new sections to the project file, especially to the LineSDKSample project (due to a new target using SPM is added). It is now not a back compatible change, so it breaks the project structure in Xcode 10. Users cannot check and run the sample project if using Xcode 10 after this gets merged. So I believe at least we should wait for Xcode 11 officially release before we can merge it.
We should also add swiftLanguageVersions and testTarget in the Package.swift to make it better.

@rmundo @eJamesLin Can you check and try it in your environments to verify the correctness of these implementation? Thanks!

👍
Successfully verified integration using both SPM and CocoaPods.
Kind of pity that user could not open the sample project by Xcode10 once merged.

I guess we will not merge it until Xcode 11 officially released. But fortunately it just affect the sample project. Carthage users can still build the LineSDK.framework target without problem even using Xcode 10.

@eJamesLin I removed the sample app using SPM, so it now can be opened without problem in Xcode 10 too. I guess it would be a good time to merge it since it is a better starting point for the binary framework feature.


Rows and Columns not reflecting properly

I'm having a couple of issues with shader reflection for matrices at the moment.

A simple shader with a 3x4 or 4x3 matrix always comes out with the dimensions flipped around. Another example, a 1x4 matrix says it has 4 rows and 1 column, always.

Matrices are also not decorated with SPV_REFLECT_DECORATION_ROW_MAJOR or the COLUMN_MAJOR variant, the decoration flags are always 0.

I'm also not understanding the stride, but it might be consistent with the rows and columns being flipped. The 3x4 matrix has a stride of 64 whereas the 4x3 has a stride of 48 bytes, whereas I would expect the opposite.

The issues all probably come from the fact that this code doesn't seem to account for them. Would it be possible to confirm whether this is indeed a bug? Thanks!
case SpvOpTypeMatrix: {
        p_type->type_flags |= SPV_REFLECT_TYPE_FLAG_MATRIX;
        uint32_t column_type_id = (uint32_t)INVALID_VALUE;
        IF_READU32(result, p_parser, p_node->word_offset + 2, column_type_id);
        IF_READU32(result, p_parser, p_node->word_offset + 3, p_type->traits.numeric.matrix.column_count);
        SpvReflectPrvNode* p_next_node = FindNode(p_parser, column_type_id);
        if (IsNotNull(p_next_node)) {
          result = ParseType(p_parser, p_next_node, NULL, p_module, p_type);
        }
        else {
          result = SPV_REFLECT_RESULT_ERROR_SPIRV_INVALID_ID_REFERENCE;
          SPV_REFLECT_ASSERT(false);
        }
        p_type->traits.numeric.matrix.row_count = p_type->traits.numeric.vector.component_count;
        p_type->traits.numeric.matrix.stride = p_node->decorations.matrix_stride;
        // NOTE: Matrix stride is decorated using OpMemberDecoreate - not OpDecoreate.
        if (IsNotNull(p_struct_member_decorations)) {
          p_type->traits.numeric.matrix.stride = p_struct_member_decorations->matrix_stride;
        }
      }
      break;

Hi,
It sounds like SPIRV-Reflect is getting confused row_major and column_major attributes confused. Would you happen to have a simple test case?
Thansks,
Hai

Yeah something really simple like below should do the trick. I compile it through glslangValidator so that the reflection data isn't optimized out like when using dxc (I use this for reflection). Would that be enough?
struct Instance
{
    row_major float1x4 local2WorldA;
    row_major float3x4 local2WorldB;
};

cbuffer Instance
{
	Instance cb_Instance;
};

float4 main() : SV_Target0
{
    return float4(0.0, 0.0, 0.0, 0.0);
}

Yes, thanks! Give me a couple of days to find another chunk of time to look at this.

example.txt
Here's also an example of the spir-v I use to generate the reflection data (rename to .spv) Hopefully we can get to the bottom of it. Thanks

I also found a couple of links which might be useful. I produce SPIR-V from hlsl, but it looks like SPIR-V has a different idea of what column/row major is.
https://github.com/microsoft/DirectXShaderCompiler/blob/master/docs/SPIR-V.rst#vectors-and-matrices
https://github.com/microsoft/DirectXShaderCompiler/blob/master/docs/SPIR-V.rst#appendix-a-matrix-representation
SPIRV-Reflect might be correct in the way it's interpreting rows and columns (so I would have to flip them), and perhaps the only bug here is that they aren't tagged as ColMajor or RowMajor. Let me know your thoughts

Thanks so much for digging into this. Apologies for follow up. I talked to one of my colleagues about this and they reminded me that there was a bit of historical confusion between what the user may perceives as the rows / cols and what's in the SPIR-V. I'll take a look at the decorations.

Hopefuly I didn't misunderstand something, but I checked the row and major decorations in the block variables and it looks like the decorations have row and column major bit set where appropriate.
As mentioned in the links you provided, the row/colum major ordering is flipped between the HLSL source and the SPIR-V if there is an explicit row_major or column_major applied - otherwise it will default to row_major .
I added two test cases for this:
https://github.com/KhronosGroup/SPIRV-Reflect/blob/master/tests/glsl/matrix_major_order_glsl.glsl
https://github.com/KhronosGroup/SPIRV-Reflect/blob/master/tests/hlsl/matrix_major_order_hlsl.hlsl
The SPIR-V for local2World shows 2 member decorate for ColMajor:
               OpMemberDecorate %33 0 ColMajor
               OpMemberDecorate %33 0 Offset 0
               OpMemberDecorate %33 0 MatrixStride 16
               OpMemberDecorate %33 1 ColMajor   // local2World
               OpMemberDecorate %33 1 Offset 16
               OpMemberDecorate %33 1 MatrixStride 16
               OpMemberDecorate %33 2 ColMajor
               OpMemberDecorate %33 2 Offset 80
               OpMemberDecorate %33 2 MatrixStride 16
               OpMemberDecorate %34 0 Offset 0

Hi @chaoticbob that they are flipped is the conclusion I got from reading that documentation, I wanted your confirmation as well. In terms of the decoration_flags I don't really see them when I check something like:
if (type.type_flags & SPV_REFLECT_TYPE_FLAG_MATRIX)
{
	bool isRowMajor = type.decoration_flags & SPV_REFLECT_DECORATION_ROW_MAJOR;
}

Maybe I need a new version of the library? I thought I was relatively up to date. I'll try a new one and get back to you.

I updated and still not able to see the decorations. This is what the type looks like:


Update @solana.web3.js version in lighthouse-sdk-legacy

I am encountering issues with the version mismatch of rpc-sockets.
After running npm ls rpc-websockets this is the output
+--<EMAIL_ADDRESS>| --<EMAIL_ADDRESS>--<EMAIL_ADDRESS>  --<EMAIL_ADDRESS>    --<EMAIL_ADDRESS>
This is the error I am encountering
Error: Package subpath './dist/lib/client' is not defined by "exports" in F:\Development\assertions-test\node_modules\rpc-websockets\package.json
And this is the code causing the problem
import {createUmi} from "@metaplex-foundation/umi";
import {createLighthouseProgram} from "lighthouse-sdk-legacy";

let umi = createUmi()
umi.programs.add(createLighthouseProgram())

After having updated the @solana/web.js to version ^1.95.8 the code executes well, I also noticed that I was not using '@metaplex-foundation/umi-bundle-defaults' instead of '@metaplex-foundation/umi'


Documentation for systemd not working

Hello,
I followed the guide to install peering-manager on debian 10. My reverse proxy is working and I can test/access to peering-manager while putting one of those two lines :
# ./manage.py runserver <IP_ADDRESS>:8001

or
/opt/peering-manager# ./venv/bin/gunicorn -c /opt/peering-manager/gunicorn_config.py peering_manager.wsgi

Both are working. However, when I use this page of the doc to create the systemd aliases https://peering-manager.readthedocs.io/en/latest/setup/3-web-server/#systemd , I'm getting those error messages on the peering-manager.service
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1103] [INFO] Starting gunicorn 20.0.4
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1103] [INFO] Listening at: http://<IP_ADDRESS>:8001 (1103)
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1103] [INFO] Using worker: threads
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1106] [INFO] Booting worker with pid: 1106
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1106] [ERROR] Exception in worker process
Jul 28 15:47:45 peering-manager gunicorn[1103]: Traceback (most recent call last):
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/arbiter.py", line 583, in spawn_worker
Jul 28 15:47:45 peering-manager gunicorn[1103]:     worker.init_process()
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/workers/gthread.py", line 92, in init_process
Jul 28 15:47:45 peering-manager gunicorn[1103]:     super().init_process()
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/workers/base.py", line 119, in init_process
Jul 28 15:47:45 peering-manager gunicorn[1103]:     self.load_wsgi()
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/workers/base.py", line 144, in load_wsgi
Jul 28 15:47:45 peering-manager gunicorn[1103]:     self.wsgi = self.app.wsgi()
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/app/base.py", line 67, in wsgi
Jul 28 15:47:45 peering-manager gunicorn[1103]:     self.callable = self.load()
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 49, in load
Jul 28 15:47:45 peering-manager gunicorn[1103]:     return self.load_wsgiapp()
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 39, in load_wsgiapp
Jul 28 15:47:45 peering-manager gunicorn[1103]:     return util.import_app(self.app_uri)
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/opt/peering-manager/venv/lib/python3.7/site-packages/gunicorn/util.py", line 358, in import_app
Jul 28 15:47:45 peering-manager gunicorn[1103]:     mod = importlib.import_module(module)
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "/usr/lib/python3.7/importlib/__init__.py", line 127, in import_module
Jul 28 15:47:45 peering-manager gunicorn[1103]:     return _bootstrap._gcd_import(name[level:], package, level)
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 983, in _find_and_load
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 983, in _find_and_load
Jul 28 15:47:45 peering-manager gunicorn[1103]:   File "<frozen importlib._bootstrap>", line 965, in _find_and_load_unlocked
Jul 28 15:47:45 peering-manager gunicorn[1103]: ModuleNotFoundError: No module named 'peering-manager'
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1106] [INFO] Worker exiting (pid: 1106)
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1103] [INFO] Shutting down: Master
Jul 28 15:47:45 peering-manager gunicorn[1103]: [2020-07-28 15:47:45 +0200] [1103] [INFO] Reason: Worker failed to boot.
Jul 28 15:47:45 peering-manager systemd[1]: peering-manager.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED
Jul 28 15:47:45 peering-manager systemd[1]: peering-manager.service: Failed with result 'exit-code'.

I'm suposing something like a path problem. However, I'm not finding it obvious right now.

I see that the example /etc/systemd/system/peering-manager.service has "peering-manager.wsgi" in it, which is wrong.
So you should replace line:
ExecStart=/opt/peering-manager/venv/bin/gunicorn --pid /var/tmp/peering-manager.pid --pythonpath /opt/peering-manager --config /opt/peering-manager/gunicorn.py peering-manager.wsgi
with
ExecStart=/opt/peering-manager/venv/bin/gunicorn --pid /var/tmp/peering-manager.pid --pythonpath /opt/peering-manager --config /opt/peering-manager/gunicorn.py peering_manager.wsgi
I could make a PR to fix this typo when I am home, but please tell me first if it works.

Hello,
I just found that issue with a friend of mine and can confirm that it's working now. I was thinking about doing the PR myself when I'm finished at work...

It was just the - to _


[Feedback to SAP] next page design iteration: missing design examples

Context: SAP has provided a design example ("Concept A") for next-gen content hub blog pages here: https://www.figma.com/file/oSetT4LbatRmXlcB2A7V8Z/Content-Hubs-2024?type=design&node-id=269-30889&mode=design&t=RZkr5VBRC2kSmAUI-0. This design example is intended to be the foundation of the content hub / blog pages.
The example is fine, but unfortunately missing certain aspects, and therefore the design implementation in Adobe AEM EDS must make a lot of assumptions.
Please add illustrations for the following aspects to the example:

There is no mobile breakpoint view
It is not clear whether left-aligned cta-banner blocks are still supported (see https://news.sap.com/2024/01/is-supply-chain-innovation-possible-era-tighter-regulation/ as an example)
No examples have been given for bullet lists (HTML: ul, ol)
There is no example for the spacing of two consecutive paragraphs (without another element between them, e.g. image or cta-banner element)
There is no example for pages whose first paragraph is an abstract (see https://news.sap.com/2024/01/is-supply-chain-innovation-possible-era-tighter-regulation/ as an example)
No example for smaller headlines (h3, h4, h5, h6) is given

@ok : I have two additional questions, which are not directly related to the page design, but more generic questions:
Q1: Links on the new design page (https://www.figma.com/file/oSetT4LbatRmXlcB2A7V8Z/Content-Hubs-2024?type=design&node-id=269-30889&mode=design&t=RZkr5VBRC2kSmAUI-0) appear to be underlined even when not hovered, while the current design shows them as only underlined when hovered. Shall I use the link design (always underlined) from the new pages?
Q2: I could not find the "SAP Blue" color code (#008fd3) in the theme design tokens (sap_glow). Is there any design token matching that color? Or will this color code be discontinued?

on Q1: no. I would be suprised if that would be the case. also easy to change afterwards
on Q2: it is a new design foundation. this should be the brand color variable: --sapBrandColor

@ok : On Q1: the new design (https://sap.frontify.com/document/223142#/-/links) indicates that links shall now always be underlined (kudos to @saurabh-khare for spotting the reference)
On Q2: Ok, thanks. I will be using --sapBrandColor

@pahupe is this still relevant or are we resolving these with Dani and Elaine on Slack on the go?


Create student.txt

Added WSB Merito University Torun
Official website : https://www.merito.pl/english/torun/
Computer science related course: https://www.merito.pl/english/torun/our-offer/bachelors-degree/programs/information-technology-in-business-web-applications-developer

Pull request merged. Thank you! @fplachecinski


Auto-Guess of Subtitle Label when loading Local Files via Regex in application.yml

The title is self explanatory.
I've put the regex used for the subtitle label with the regexes of movies and tv shows in the application.yml, then it gets loaded when needed.
I've tested it for a few minutes now, and it seems to work just fine!
Good day!

The only thing that could be missing is a setting or something that allows you to turn this off, but I'm afraid I don't know how to add a new global setting (like the click-to-pause setting, for example).

This has been open for ages, sorry! to give you a hint on your second question: check out settingsService.getValueForName('user_activity_rotation')where user_activity_rotation is a name of a setting-instance.

I personally would like to add this feature, but disabled by default maybe? and then people can enable this if they wish to do so

Super cool, thanks for the contribution!


'Clear Expiration Date' button

The 'Clear Expiration Date' button, with the default theme, is very hard to see.

I'll fix this on my branch


Fix some imports

Fixes some import deprecations that show while building phobos tests.
There are still other import problems but they are trickier to solve.

Thanks! Especially the array imports kept spamming the build log.
LGTM

Looks like a FreeBSD 64-bit test timed out.

Auto-merge toggled on


Added づ section

Added information about how to type だ行 to the "How to Type" section

Deploy preview for wanikani-knowledgebase processing.
Building with commit 814c3fbf281f0b30a95651d9f457c13e57ab730d
https://app.netlify.com/sites/wanikani-knowledgebase/deploys/5cd352c97432f9000d92f998


Update docs on usage of get-esm-packages command

Update docs to show an example of how to use get-esm-packages since some developer might not be aware of how to pass the list of arguments as package name.

Thanks for the PR


fix: enable support for firebasedatabase.app

Closes https://github.com/firebase/firebase-admin-go/issues/415

@googlebot I signed it!


test: Update benchmarks to use buffer

Update benchmarks so that operations run on a full buffer for consistency.

Codecov Report

Merging #60 (7816d13) into main (aad6594) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files

@@            Coverage Diff            @@
##              main       #60   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            1         1
  Lines           99        99
=========================================
  Hits            99        99


bit:* extension functions should accept string arguments

The functions in the "bit" extension library only handle number type arguments, using code like:
if (xop->type == XPATH_NUMBER) {
    ...
 }

They need an "else if (xop->type == XPATH_STRING) { ... }" clause.
Thanks,
Phil

fixed in HEAD


MacOS Build working on 20240405.2 fails testflight submit on 20240415.1

Description
With no changes to Xcode settings a build that worked on MacOS 13 image 20240405.2 now fails on image 20240415.1. I don't see a way to choose a specific image.
It fails because of how a binary dependency is getting bundled. Tesflight rejects the submission. I presume that there's a default setting in the image that has changed and there's likely some explicit setting we can add to overcome this, but we don't know what it is. We don't have any explicit settings related to this bundle in our project.
Here's the redacted error we get from apple when submitting to testflight:
2024-04-18 10:43:05.241 *** Error: Error uploading 'XXXXXXXX.ipa'.
2024-04-18 10:43:05.241 *** Error: Asset validation failed Invalid bundle structure. The "XXXXXXXXX.app/RealmJS.bundle/RealmJS" binary file is not permitted. Your app cannot contain standalone executables or libraries, other than a valid CFBundleExecutable of supported bundles. For details, visit: https://developer.apple.com/documentation/bundleresources/placing_content_in_a_bundle (ID: XXXXXXXXXXXXX) (90171)
 {
    NSLocalizedDescription = "Asset validation failed";
    NSLocalizedFailureReason = "Invalid bundle structure. The \U201cXXXXXXXXXX.app/RealmJS.bundle/RealmJS\U201d binary file is not permitted. Your app cannot contain standalone executables or libraries, other than a valid CFBundleExecutable of supported bundles. For details, visit: https://developer.apple.com/documentation/bundleresources/placing_content_in_a_bundle (ID: XXXXXXXXXXXXX)";
    NSUnderlyingError = "Error Domain=IrisAPI Code=-19241 \"Asset validation failed\" UserInfo={status=409, detail=Invalid bundle structure. The \U201cXXXXXXXXXXXXX.app/RealmJS.bundle/RealmJS\U201d binary file is not permitted. Your app cannot contain standalone executables or libraries, other than a valid CFBundleExecutable of supported bundles. For details, visit: https://developer.apple.com/documentation/bundleresources/placing_content_in_a_bundle, id=XXXXXXXXXXXXX, code=STATE_ERROR.VALIDATION_ERROR.90171, title=Asset validation failed, NSLocalizedFailureReason=Invalid bundle structure. The \U201cActiveOversightMobile.app/RealmJS.bundle/RealmJS\U201d binary file is not permitted. Your app cannot contain standalone executables or libraries, other than a valid CFBundleExecutable of supported bundles. For details, visit: https://developer.apple.com/documentation/bundleresources/placing_content_in_a_bundle, NSLocalizedDescription=Asset validation failed}";
    "iris-code" = "STATE_ERROR.VALIDATION_ERROR.90171";
}

Platforms affected

[ ] Azure DevOps
[X] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[X] macOS 13
[ ] macOS 13 Arm64
[ ] macOS 14
[ ] macOS 14 Arm64
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
20240415.1.  This is in a private repo. I'd be happy to walk someone through some extra data collection if it would be helpful.
Is it regression?
20240405.2
Expected behavior
Testflight submission succeeds
Actual behavior
Testflight submission fails because of bundling error.
Repro steps

Start Build
Upon testflight submission step, the action fails with the above error.

Thanks for the pointer to the real root cause @MaksimZhukov . Appreciate it!


LUX (light sensor) re-calibration

Is your feature request related to a problem? Please describe.
For some light sensors a re-calibration of the light sensor data may be necessary. In my use-case the manufacturer (GENEActiv) provided me with the calibration coefficients that will need to be applied to all data from a study that took place in 2012-2013. At the moment GGIR cannot facilitate this.
Describe the solution you'd like
I would like to add an option in part 5 to do the calibration based on the peak light values per large epoch as derived in part 1. Part 5 will be the part where we will do the main light exposure analysis.
Describe alternatives you've considered

We could also do this in GGIR part 1 right after the raw data is read. However, doing it in part 5 makes it easy to change the calibration coefficients and computationally faster. If we fiddle with the data in part 1 all data needs to be reprocessed every time a correction is made to the calibration coefficients.
We cannot hardcode this because the calibration coefficients are likely to be brand or batch specific. So, it is best to let the user specify the coefficient directly per dataset. I have no indication that there is a need for using device serial number specific calibration coefficients.

Closing this issue, because merged with master branch, see GGIR g.part5 function documentation of arguments with the letters "lux" for details. In the end I decided to apply the LUX calibration in g.part5.


yara-python could not compile the rule.yar

import "androguard"

rule malware :
{
    condition:
         androguard.url(/inappertising\.org/)
}

~/androguard-yara$ yara -x androguard=1406864c1be8a763be2bba9b446a07b3e7c0b66a785f82e5005ba2bbb4305c83-report.json rule.yar sample.apk
malware sample.apk

It works.
But I want to compile the rule.yar by python:
./test.py
Traceback (most recent call last):
  File "./test.py", line 13, in <module>
    rules = yara.compile('rule.yar')
yara.SyntaxError: rule.yar(8): invalid field name "url"

Any idea?

Did you fix it?

@plutec I'm not sure, I think maybe I need to build the yara-python again, and install it.

Well, I will try it with another way to resolve my problem.

Yes, you need to install yara-python with the flags --enable-cuckoo, for instance:
touch yara-python.c #Recommended
python setup.py build --enable-cuckoo
sudo python setup.py install


Can we do better using a render graph approach?

We're now juggling 2D cameras, render layers, and camera priorities.
This has a chance of collision if a user actually uses non-default render layers and camera priorities themselves.
This can get messy.
If we do a render graph based approach with our own post processing node, perhaps we can have more control.

https://github.com/bevyengine/bevy/pull/3430/files#diff-f3b0002ebc5b04651ad671e722125208b6b7a522c873d0dcb4d6ae85d69409f7
This PR might have some insight on how to work with the render graph.


[PINOT-6701] Controller API to check storage quota before segment upload

Expose a controller API to check storage quota before segments are uploaded. The API expects, as a query parameter, the uncompressed size of all segments that are to be uploaded. The API accounts for the appropriate push-type (refresh vs append) and whether the segments to be uploaded have indices or not and returns whether the upload can go through or not.
Eventually, we will drop the quota checks that are done per segment and expect all push jobs to call this API before starting the upload. That will save a lot of unnecessary calls to the servers for get table sizes as well as prevent partial uploads if the size is exceeded mid way through the segments push.
Testing Done: added integration test that covers the append use-case upload. Plan to add more after initial review.

Closed this PR due to 6 months inactivity. Reopen if needed.


user authentication system

validate whether user exists in system. if not, deny service.

commit d20d38b04a65f1a9f3cbc44a36abfd6e13208710 defined the authentication method.
commit 4960a4d2baf78ca354e1417b5356c915d4cc9df4 integrates authentication into the api calls.
authentication is done before the request is processed.


Creating ESLD Jump Beacons file.

Submitting this for CKAN support, thanks!  Let me know if I've bollocksed the syntax.

Identifier must match filename :)

Whoops, sorry.  Can you clarify?  I matched it to the name of my dll file, what filename should I have used?

the identifier inside your netkan file must match the name of the netkan file :)

Changed!

Whoops, something else seems to have gone wrong.  Do I need to provide an install tag in the markup to prevent that error?

Yes, you need the install tag as it attempts with the identifier as a filename.


[WIP][SPARK-19610][SQL] Support parsing multiline CSV files

What changes were proposed in this pull request?
This PR proposes the support for multiple lines for CSV.
How was this patch tested?
Unit tests in CSVSuite and tests.py
Manual tests with a single 9GB CSV file in local file system as below:
spark.read.option("wholeFile", true).option("inferSchema", true).csv("tmp.csv").count()

(I should clean it up more and take a look into this deeper. I left open this for running tests.)

Test build #73062 has started for PR 16976 at commit 3a303c7.

Test build #73063 has started for PR 16976 at commit 8275d12.

Test build #73062 has finished for PR 16976 at commit 3a303c7.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
abstract class CSVDataSource extends Serializable

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73062/
Test PASSed.

Test build #73063 has finished for PR 16976 at commit 8275d12.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
abstract class CSVDataSource extends Serializable

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73063/
Test PASSed.

cc @NathanHowell, this basically resembles your implementation. Could you take a look please?

Test build #73088 has started for PR 16976 at commit 44c9465.

cc @cloud-fan too.

Test build #73089 has started for PR 16976 at commit 373eec9.

Test build #73088 has finished for PR 16976 at commit 44c9465.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73088/
Test FAILed.

Merged build finished. Test FAILed.

Test build #73089 has finished for PR 16976 at commit 373eec9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73089/
Test PASSed.

Test build #73105 has started for PR 16976 at commit 2ddbf15.

Test build #73105 has finished for PR 16976 at commit 2ddbf15.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73105/
Test PASSed.

hmm, I understand the motivation for this, though my understanding with csv generally either avoid having newline in field or some implementation would require quotes around field value with newline
https://en.wikipedia.org/wiki/Comma-separated_values#General_functionality

I initially left the similar comment in the same JIRAs. However, that there are a quite bit of similar JIRAs complaining about this and the original CSV (as the thirdparty library) tries to supports this although that is incorrectly implemented. This tries to match it with JSON one at least and it might be better to provide a way to process such CSV files. Actually, current implementation require quotes :).

I see, fair enough. cc @falaki

Test build #73334 has started for PR 16976 at commit 4dc48e1.

Test build #73336 has started for PR 16976 at commit e00bdee.

Test build #73334 has finished for PR 16976 at commit 4dc48e1.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73334/
Test FAILed.

Merged build finished. Test FAILed.

Test build #73341 has started for PR 16976 at commit 8474933.

Thanks for your review @NathanHowell and @cloud-fan. I just addressed them and ran a build with Scala 2.10 per 8474933.

Test build #73336 has finished for PR 16976 at commit e00bdee.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73336/
Test PASSed.

Test build #73341 has finished for PR 16976 at commit 8474933.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73341/
Test PASSed.

Test build #73417 has started for PR 16976 at commit fbdfc61.

Test build #73422 has started for PR 16976 at commit 5d0bab4.

Test build #73423 has started for PR 16976 at commit 793a3eb.

Test build #73422 has finished for PR 16976 at commit 5d0bab4.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73422/
Test FAILed.

Test build #73417 has finished for PR 16976 at commit fbdfc61.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73417/
Test PASSed.

Merged build finished. Test PASSed.

Test build #73423 has finished for PR 16976 at commit 793a3eb.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73423/
Test PASSed.

Test build #73454 has started for PR 16976 at commit 321d082.

Test build #73455 has started for PR 16976 at commit b4e6983.

@cloud-fan, I am running a build with 2.10 per b4e6983. I think it is ready for another look.

Test build #73456 has started for PR 16976 at commit 6187f6c.

Test build #73457 has started for PR 16976 at commit b7d56c6.

Test build #73454 has finished for PR 16976 at commit 321d082.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73454/
Test PASSed.

Test build #73455 has finished for PR 16976 at commit b4e6983.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73455/
Test PASSed.

Test build #73456 has finished for PR 16976 at commit 6187f6c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73456/
Test PASSed.

Merged build finished. Test PASSed.

Test build #73457 has finished for PR 16976 at commit b7d56c6.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73457/
Test PASSed.

Test build #73493 has started for PR 16976 at commit 22eb29e.

Test build #73493 has finished for PR 16976 at commit 22eb29e.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
abstract class CSVDataSource extends Serializable

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73493/
Test PASSed.

Merged build finished. Test PASSed.

thanks, merging to master!

Dont think it quite works.
spark.read.option("wholeFile", "true").option("header", "true").option("inferSchema", "true").csv("FILE.csv").show()
+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+-----+-------+
|          article_id|                date|     goldstein_scale|            avg_tone|              source|              domain|                text|title|authors|
+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+--------------------+-----+-------+
|           671907787|            20170710|                  -2|   -2.75049115913556|http://www.blackl...|http://www.blackl...|As much as the U....| null|   null|
|Russian President...|                2014| celebrating the ...|                null|                null|                null|                null| null|   null|

Can you open a JIRA with more description, expected input, and expected output?

don't think it quite works
+1 i could not get this to work either @raviolli

Does it need the univocity parser to be specified as suggested initially here https://github.com/databricks/spark-csv/issues/175 ?

The wholeFile option doesn't seem to be working.
Test file content:
"num_col1","txt_col","num_col2"
10001,"regular string",20001
10002,"string with
newline",20002
Command and result:

dfu = sqlContext.read.format('com.databricks.spark.csv').option("header","true").option("inferschema","true").option("delimiter",",").option("quote",'"').option("parserLib","univocity").option("wholeFile","true").load('new_line.csv')
dfu.show(3,False)
+--------+--------------+--------+
|num_col1|txt_col       |num_col2|
+--------+--------------+--------+
|10001   |regular string|20001   |
|10002   |string with   |null    |
|newline"|20002         |null    |
+--------+--------------+--------+

Expected result:
+--------+--------------+--------+
|num_col1|txt_col       |num_col2|
+--------+--------------+--------+
|10001   |regular string|20001   |
|10002   |string with\nnewline||20002   |
+--------+--------------+--------+
Spark version used 2.2
17/11/16 17:15:37 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Welcome to
____              __
/ /  ___ / /
\ / _ / _ `/ __/  '/
/ / ._/_,// //_\   version 2.2.0
//
Using Python version 2.7.5 (default, May  3 2017 07:55:04)
SparkSession available as 'spark'.
Please let me know if I am missing something here

It was renamed multiLine before the release. Could we try out it instead?

Guys, please use the mailing list or JIRA ...

Thanks Kwon. It worked


using demo in asp.net web forms cause a non return values to my controls in code behind

Hi, I have used the mmenu demo in my web application.
I have a search button that should return to me a text value.
When I stopped the mmenu.js from my page and now I m obtained the value.
master page:

...

In code behind I have a break point but with no value for text

Hi,
I have found the problem causing this issue.
I m using mmenu.all.js and fixedelements.js together and this cause for not sending any data to code behind.
I have replace the all.js and fixedelements.js by each library individually and the problem is fixed.
The problem now is that when Im using some of these libraries the whole page including the footer is shaking like a zumba dance.
if there is a fix for this problem I appreciate. thanks.

I'm not sure what you did to solve this issue (nor how a page shaking like a zumba dance would look like), but if you've include the .all.js file, you already have the fixedelements.js file so you don't need to include it seporately.

I didn't know that .all.js include also fixedelements.js anyway I have same result; I have stopped every js library except jquery and all.js and no result for my controls in my code behind, and when I use mmenu libraries individually the result appears normally but I'm loosing the fixation of the footer and not all libraries work for me they directly stop my controls to give results.
It seems there is an error in some of these libraries and in all.js.
By the way thanks a lot for your fast response, really I appreciate and I will donate because you  deserve  Really.

Do you have any suggestions about this issue?

I don't think I understand the issue, is there an online example?

No, but the problem is that if I use mmenu.all.js, all the returning values are empty in code behind file like the picture above. If I use mmenu.js, I got all my values normally.
I need to use .all.js for many reasons like fixation for the header and footer..., thanks.

I can't think of a reason why the seporate files would behave different from the concatinated file.
Does it make any difference if you include all minified files seporately instead of the concatinated file?

I can only use mmenu.js, dragopen.js and buttonbars.js, All the rest libraries if I use them I loose my values.

Are you getting any errors?
The seporate files seem to be working OK over here so I don't think there is much I can do.

No errors and  the seperate files are not working ok (fixedelements, counters, header, footer, labels, toggles, searchfield and all.js) the problem reside in these files they are stopping my values. Thanks.

Hi, If you can see this issue again thanks.

What exactly do you mean when you say "the files are stopping your values"?
All files seem to work fine on the website and in the demo pages.

I m using the libraries in asp.net webforms applications and when I use (fixedelements, counters, header, footer, labels, toggles, searchfield and all.js) the returning values in my code behind for all my controls give empty results. You can see this in my first comment. thanks.

I really don't understand what you mean with "returning values in my code behind".
I don't think I can help you with that.
Like I mentioned before, all files seem to work fine on the website and in the demo pages. So I don't think there is much I can change anyway.

The thing is when postback to the server my values are empty it's possible that these libraries are affecting the postback in some way.

If there is a replacement for fixed elements I can use it it will solve my problem because on IE the header and footer are fixed and don't move when opening the menu and I can 't use the fixedelements library it will stop my values like i told you before thanks.

Please If you can answer me to fix this issue, Thanks?

Basically, all the fixed elements add-on does, is add a classname (mm-fixed) to the elements and put them directly inside the BODY.
You can manually do that (either with JS or by changing the HTML) and remove the add-on.
I really have no idea about postback values to the server.


unintended 'diagnostic' strings left in code?

I recently upgraded to 0.58-3, via vcpkg, and I noticed something new.  I have a console application and when I read from a table I see repeated
my_string:
my_string:
my_string:
my_string:
...
messages displayed to stdout/err.  The statement that generates these messages is fairly innocuous.  I just step over a 'for' statement and I see the messages.
`
const auto table = Cores::SchedulableCapacity{};
sql::connection db( _pParent->GetDbConnection() );
auto s = dynamic_select( db, all_of( table ) ).from( table ).dynamic_where();
s.where.add( table.id == objInfo.GetId() );
for ( const auto& row : db( s ) )
`
I don't think this happened in the previous version.  The query seemed to work, though.

Hi,
Thanks for the report. This was accidentally introduced into the mysql connector in January 2019. Seems like not too many people are using date-time in mysql...
It should now be fixed (but I am not sure how quickly it will be updated in vcpkg).
Best,
Roland

I also noticed this yesterday. I am on Windows.
vcpkg currently show 0.26 version for mysql connector while 0.27 has the fix and latest seems to be 0.29. For sqlpp also now i check it show 58.3 although latest is 59.  Seems something could be wrong with updates?

Hi,
Thanks for the report.
I have absolutely no experience with vcpkg. Who can pick this up?
Cheers,
Roland

I am guessing this is fixed in vcpkg by now, too. Otherwise, file a bug there :-)


react-native-blob-util getConstants error in expo snack android / ios

Summary
Importing react-native-blob-util in Expo Snack throws the error
null is not an object (evaluating 's.default.getConstants')

This error does not show up in a normal project.
What platform(s) does this occur on?
Android, iOS
SDK Version
47.0.0
Reproducible demo or steps to reproduce from a blank project
simplest repro: https://snack.expo.dev/7gchaAZa2 . Steps:

create a new snack
add a dependency on react-native-blob-util in package.json
import the dependency somewhere in App.js

.
For an apples-to-apples comparison, https://docs.sheetjs.com/docs/getting-started/example#run-the-demo-locally select "Mobile App".  The macOS + iOS, macOS + Android, and Win10 + Android steps have been tested on multiple machines.
The same code in a snack: https://snack.expo.dev/CzKgQUjCH
Android fails with:

iOS fails with:

I am getting the same error, is there any solution??

I have the same error and my project is stuck, any solution or similar package ?

But this is likely to the fact that I'm heavily using native code written in java and the lib not being part of the Expo SDK. So you can't use it.

But this is likely to the fact that I'm heavily using native code written in java and the lib not being part of the Expo SDK. So you can't use it.

Are you planning to make this module work with expo or do you know any substitute for you package which works on expo?

hello having same issue here is it fixed?

Same here


Question: Disabling auto-wiring if needed?

Coming from Zend\ServiceManager\ServiceManager, I wondered if anyone besides me would find it useful if the Container could be configured to throw exceptions when it is attempted to retrieve a service which

isn't registered
isn't provided by any of the registered service providers

What do you think?
/cc @alucic

I did something similar by extending the container class, but I send notices to a logger when reflection is used instead.
On Jul 27, 2015 09:02, Andreas Möller<EMAIL_ADDRESS>wrote:Coming from Zend\ServiceManager\ServiceManager, I wondered if anyone besides me would find it useful if the Container could be configured to throw exceptions when it is attempted to retrieve a service which
isn't registeredisn't provided by any of the registered service providers
What do you think?
/cc @alucic
—Reply to this email directly or view it on GitHub.

v2 which is due later this week/weekend will disable auto wiring by default unless you explicitly tell it to do so. I think I've settled on exceptions being thrown for when a service is not registered.

@philipobenito
Awesome!