Add non-UTF-8 support to utils

DO NOT MERGE YET!!!
I am planning on rewriting all the utils to have at least basic support for non-UTF-8 arguments and such, addressing #203, #554, #699, #1006, and #1050 (there may be more, but this is what I found after a quick check).  This pull request is to keep track of my progress.
Generally, adding support entails switching from getopts to clap and converting String-based arguments to OsString.  Some utilities require more in-depth changes as they either mess with the arguments or retrieve OS-specific data (which we currently convert to Strings).
If anyone is interesting in helping, you should probably start from the top as I am pretty much starting from the end of the list.
Progress (some utils are likely not marked):

[ ] arch
[ ] base32
[ ] base64
[ ] basename
[ ] cat
[ ] chgrp
[ ] chmod
[ ] chown
[ ] chroot
[ ] cksum
[ ] comm
[ ] cp
[ ] cut
[ ] dircolors
[ ] dirname
[ ] du
[ ] echo
[ ] env
[ ] expand
[ ] expr
[ ] factor
[ ] false
[ ] fmt
[ ] fold
[ ] groups
[ ] hashsum
[ ] head
[ ] hostid
[ ] hostname
[ ] id
[ ] install
[ ] kill
[ ] link
[ ] ln
[ ] logname
[ ] ls
[ ] mkdir
[ ] mkfifo
[ ] mknod
[ ] mktemp
[ ] mv
[ ] more (in progress, needs lots of work)
[ ] nice
[ ] nl
[ ] nohup
[ ] nproc
[ ] od (almost complete, --strings and 128-bit datatypes are missing)
[ ] paste
[ ] pathchk
[ ] pinky
[ ] printenv
[ ] printf
[ ] ptx
[ ] pwd
[ ] readlink
[ ] realpath
[ ] relpath
[x] rm (although Path::display() probably uses to_string_lossy() behind-the-scenes)
[ ] rmdir
[ ] seq
[ ] shred
[ ] shuf
[x] sleep
[ ] sort
[ ] split
[ ] stat
[ ] stdbuf
[ ] sum
[ ] sync
[ ] tac
[ ] tail
[ ] tee
[ ] test
[ ] timeout
[ ] touch
[ ] tr
[ ] true
[ ] truncate
[ ] tsort
[ ] tty
[ ] uname
[ ] unexpand
[ ] uniq
[ ] unlink
[ ] uptime
[ ] users
[x] uutils
[ ] wc
[ ] who
[x] whoami (not sure if username in /etc/passwd is ever non-UTF-8?)
[x] yes

To make helping easier, there should be some basic tests included to generate non-UTF-8 filenames and sample arguments. At the very least, a file or Gist with a bunch of non-UTF-8 names that can be copied and pasted would help.

Found a good such file: http://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-test.txt

I'm unable to compile your patch's yes crate. And, while trying to implement a non-UTF-8 echo, the clap crate seems to be unable to handle non-utf-8 inputs; it crashes at runtime in App::get_matches_from.

Yes, I was planning on adding a test file later.  Thanks for the link. :)
What platform are you on?  It seems clap may not support Windows according to this, although perhaps I am missing something.  If it doesn't, we may have to switch to some other argument parser.
What error are you getting for yes?  I probably forgot to change something while updating it to use OsString/OsStr.

Windows 10. I also had compile errors for rm.
For yes, I'm getting an error at the line byte_print!() in exec(). It seems to dislike &output, rather than just output, though I'm not sure.

I'll try to figure something out for Windows.  In the meantime, does yes work if you change &output to &output[..]?
I'll take a look at rm (I probably messed up on something similar...).

@Arcterus Just a suggestion: why not create a separate issue and PR for each util, maybe associated with a milestone? That way you could still keep track of the progress but visibility of this topic would be greater and you could integrate into master more often, thus avoiding rebases if things change there...

@shutefan I think I'm going to do that.  The original plan was to just do this within a week or two, but it seems that idea fell through.  I'll start making separate PRs once finals are over.

So I'm gonna close this in favor of updating everything in a series of steps.  The first step will be to convert everything that uses getopts to use clap, which will then be followed by switching the utils to use Vec<OsString> instead of Vec<String> as the arguments.  After this, each util will need to updated to make use of OsString rather than String.


PATH env var duplicated in /etc/environment

Description
the line
add_etc_environment_variable "PATH" "${ENVPATH}"
in file images/ubuntu/scripts/build/configure-system.sh duplicates the PATH in the /etc/environment file, once with quotes, once without. Possibly the add_etc_environment_variable should be the replace variant.
Platforms affected

[ ] Azure DevOps
[ ] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[X] Ubuntu 20.04
[X] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[ ] macOS 13
[ ] macOS 13 Arm64
[ ] macOS 14
[ ] macOS 14 Arm64
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
for example ubuntu22/20240201 or any recent ubuntu stable release
Is it regression?

Expected behavior
Only one PATH entry in /etc/environment, without quotes
Actual behavior
/etc/environment for example contains two PATH entries
PATH="/snap/bin:$HOME/.local/bin:/opt/pipx_bin:$HOME/.cargo/bin:$HOME/.config/composer/vendor/bin:/usr/local/.ghcup/bin:$HOME/.dotnet/tools:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
PATH=/snap/bin:$HOME/.local/bin:/opt/pipx_bin:$HOME/.cargo/bin:$HOME/.config/composer/vendor/bin:/usr/local/.ghcup/bin:$HOME/.dotnet/tools:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
Repro steps
build an ubuntu-20 or ubuntu-22 image

Hello @mhever!
Thank you for reporting this!
We will investigate it

Deployed to production!


Specify input .winmd files in windows-bindgen

Motivation
Currently windows-bindgen crate seems to always look for .winmd files in .windows subdirectory. There should be a way to specify input files/directories.
Drawbacks
The need to specify input path, or a more complex logic selecting defaults
Rationale and alternatives
When generating a .winmd file (see WinRT component sample), I would like to put it into cargo’s $OUT_DIR and then generate a protection from it.
Additional context
No response

Yes, the underlying reader used by the bindgen crate is shared by the older gen crate. Once I've finally removed the gen crate this should be simpler and I expect the bindgen crate simply to rely on procedural input to declare winmd files.


3.0 Pre-Release Polish -- Bug Fixes / Style Fixes / Misc

What type of PR is this? (check all applicable)

[ ] Refactor
[x] Feature
[x] Bug Fix
[ ] Optimization
[ ] Documentation Update

Have you discussed this change with the InvokeAI team?

[x] Yes
[ ] No, because:

Description
Making some final style fixes before we push the next 3.0 version tomorrow.

Fixed light mode colors in Settings Modal.
Double checked other light mode colors. Nothing seems off.
Added Base Model badge to the model list item. Makes it visually better and also serves as a quick glance feature for the user.
Some minor styling updates to the Node Editor.
Fixed hotkeys 'G' and 'O', 'Shift+G' and 'Shift+O' used to toggle the panels not resizing canvas. #3780
Fixed hotkey 'N' not working for Snap To Grid on Canvas.
Fixed brush opacity hotkeys not working.
Cleaned up hotkeys modal of hotkeys that are no longer used.
Updated compel requirement to 2.0.0

Related Tickets & Documents

Related Issue #
Closes #3780

QA Instructions, Screenshots, Recordings

Added/updated tests?

[ ] Yes
[x] No : please replace this line with details on why tests
have not been included

[optional] Are there any post deployment tasks we need to perform?

@lstein Leaving a note here too in case it gets lost on Discord. Merge this in before you release the next beta please. Thank you.

not sure if you want to look at this, but the load more arrow on the t2i has stopped working (does not load more images)
this button: (not sure when it stopped working)

not sure if you want to look at this, but the load more arrow on the t2i has stopped working (does not load more images)
this button: (no idea when it stopped working)

I saw the icon earlier today and it vanished on refresh. I presumed it was a bug. Didn't realize it was for load more. I'll take a look. But might be a while. If you spot it in the meanwhile, feel free to make a PR. I can merge that in here.


[Enhancement] Reject for creation of OLAP external table whose target cluster is self

backport #25441

[FE PR Coverage Check]
:disappointed: fail : 6 / 11 (54.55%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
0
4
00.00%
[2011, 2012, 2013, 2014]

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
0
1
00.00%
[506]

:large_blue_circle:
com/starrocks/server/NodeMgr.java
6
6
100.00%
[]


Cool Hovering efffect in NavBar Section.

Describe the feature
On hovering an Div will move from -100 to 100 top position ,this will better the user engagement.
Add ScreenShots

THIS HOW IT WOULD LOOK LIKE WHEN I TRANSFORM->
https://github.com/Its-Aman-Yadav/Community-Site/assets/155324040/98135200-1e3e-4c38-8fdd-3971262285c7
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

hello PA,
kindly Assign this issue to me.

@Kalivarapubindusree can i do complete this task? Please assign me


⚠ Minetest Wiki (for comparison against mirror) has degraded performance

In 73838be, Minetest Wiki (for comparison against mirror) (https://wiki.minetest.net/Main_Page) experienced degraded performance:

HTTP code: 200
Response time: 3500 ms

Resolved: Minetest Wiki (for comparison against mirror) performance has improved in 4db5661 after 16 minutes.


Feature Request: Forking Non-DAT Archive Websites

I'd like to be able to access an HTTP website in the same way as I would a DAT archive. Namely, I'd like to have a local copy of the site that I can access even when I don't have a reliable or fast internet connection. A naive approach would be to use a tool like HTTrack (GPL) to clone a website and then convert that into a DAT archive. I think if this is integrated into the UX of beaker in a similar way to the forking of dat sites, this can be a functional solution that takes advantage of the existing DAT archive features.

Yeah that'd be a pretty nice feature. I'm interested in exploring it.

"Save page as Dat archive"

I'd love to see this too. Potentially leveraging something like this:
https://github.com/internetarchive/brozzler
https://github.com/internetarchive/warcprox


No module named 'openfold'

Hello! When I tried to run scripts/esmfold_inference.py, I got this error:
  File "/Users/yesol/opt/anaconda3/envs/ml/lib/python3.9/site-packages/esm/esmfold/v1/esmfold.py", line 11, in <module>
    from openfold.data.data_transforms import make_atom14_masks
ModuleNotFoundError: No module named 'openfold'

I found github page for OpenFold. Do I need to install this first? If so, did I miss this somehow in the installation instruction? Or can I just copy their data_transforms.py script if this is the only part used in ESM?
Thank you very much.

Hello,
May I ask how you found the solution to your problem? I'm struggling with a very similar problem.
Thanks in advance!

Hi @JasperGeissler ,
It was a hardware issue in my case. I simply realized that my computer was not CUDA-compatible which was mentioned in the installation instruction but I overlooked it. I ended up using the colab environment.


fix: add severity to user function error reporting

Refs https://github.com/lightbend/kalix-proxy/issues/1566. Builds on #392.

Rebased and ready for review now.


Why do listeners also have to block/wait for each other?

Having emitter wait for all subscribers/listeners is quite useful however, I don't see a reason why multiple listeners have to block each other and executed in sequence (they should run independently). The listeners should run in parallel (i.e. Promise.all(listeners)).
(E.g. code below shows C being blocked until B is finished)
const AwaitEventEmitter = require('await-event-emitter').default

const emitter = new AwaitEventEmitter()
const tick = (name,args,time) =>
  new Promise((resolve) => {
    setTimeout(() => {
      console.log(`${name} -${args}`);
      resolve()
    }, time || 1000)
  })

emitter.on('event', async (args) => {  await tick('A',args) });
emitter.on('event', async (args) => {  await tick('B',args,4000) });
emitter.on('event', async (args) => {  await tick('C',args) });

async function run() {
  await emitter.emit('event', 'one')
  await emitter.emit('event', 'two')
  emitter.emitSync('event', 'three')
}
run();

Hi, @ak99372  node-await-event-emitter is just implements the series processing, If you need parallel case, Please use the package tapable which is used by webpack.


DRILL-4783: Fixed baseline related to flatten

Fixed the baseline for flatten cases as per DRILL-4783 behavior.
@cchang738  please review

LGTM. +1


[release-2.9] Upgrade to Thanos v0.32.5

[ ] I added CHANGELOG entry for this change.
[ ] Change is not relevant to the end user.

Changes
Changelog and upstream Thanos release specify all the changes included in this
Verification

@saswatamcode holding off this merge while we get ACM 2.9 out. Looks like they need to respin the downstream

@subbarao-meduri wouldn't ACM 2.9 be more stable, if we had this in place?

What's "respin the downstream"?

superseded by https://github.com/stolostron/thanos/pull/99 - closing.


Responsive Logo in Navbar and Footer.

Related Issue

Issue No. #215

Changes you made :

Added Responsiveness to Logo at 991px in Navbar and at 630px in Footer.

Describe the changes :

Initially the Navbar and Footer Logo was not Responsive for Screen sizes 991px and 630px, I made it to fit inside at these screen sizes and added responsiveness.

This change makes the website look more professional and asthetic.

Check list :

[x] I have followed code style of this project.
[x] I have read the CONTRIBUTING document.
[x] All the aspects mentioned in the issue are covered.
[x] The website is properly working after my changes.
[x] 🌟 ed the repo

Type of change :

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)

Work Done Video: 😃
Output Screenshots :

https://user-images.githubusercontent.com/113718835/195426951-76116128-32b7-4ca0-80ca-aac813ada144.mp4

@AnirudhHanda Good
Plz resolve branch conflicts for merging

@AnirudhHanda Good Plz resolve branch conflicts for merging

Conflicts resolved, Kindly Merge into the main. Thank You...

@AnirudhHanda Good
LGTM 💯

@AnirudhHanda Good LGTM 💯

Thank you sir !


WC-2707 Only submit non-empty traces to trace workers

Currently, any invocation for a stage generates a trace, even for PipelineLogLevel::NONE. The only difference is that NONE does not attach logs, exceptions, or eventInfo to the trace.
This leads us to see traces with a null event for stages you opted to not get traces from, which we often see when there's a FPW in a pipeline that we did not intend to see.
There are quite a few places throughout this and edgeworker that note that we do this to "keep the request tree contiguous", but from my investigation and chats with other people, these traces are not used for anything other than delivery to trace/tail handlers, i.e. this isn't used to report metrics or billing. So there's no reason to filter these out before delivering traces.
This is of course not as efficient as it could be, as we are allocating for empty traces and then discarding them before submitting. A more comprehensive approach would be to not generate traces at all when the stage / subpipeline's log level is NONE, but that's probably beyond me currently (although I would welcome the help).
I do have a tests that are tweaked to reflect these changes in edgeworker, but there seem to be some quirks / nuances I don't understand there (for example, the tests pass normally but do not pass for process sandboxing) so I was recommended to get a PR up to workerd to begin the discussion here.

@anonrig i have ew-tests written in edgeworker that cover the changes; is there a suitable place to do something similar here?

@anonrig i have ew-tests written in edgeworker that cover the changes; is there a suitable place to do something similar here?

If there is a test in the downstream repo, I don't think we need an additional one here. Thanks!

Rebased the branch and created a downstream PR so we can ship this.


webshim html5 form validation polyfill doesn't run w/ 0.5.5 / 0.6 webcomponents.js present

I've tried removing all options and just loading the forms portion of https://afarkas.github.io/webshim/demos/index.html#Forms-forms, no dice. forms-ext works (at least the date input polyfill).  I've forked a sample fiddle from webshim to show this (originally fails in a local app I'm developing). Using https://cdnjs.cloudflare.com/ajax/libs/webcomponentsjs/0.6.0/webcomponents.min.js has the same result. No JS errors in dev console.
https://afarkas.github.io/webshim/demos/demos/forms.html#Locale-customMessages webshim functionality in question.
http://jsfiddle.net/trixta/9859C/light/ (original example)
http://jsfiddle.net/erutan/Lso7gc4c/1/ (as above with https://cdnjs.cloudflare.com/ajax/libs/webcomponentsjs/0.5.5/webcomponents.min.js included as external dependency)
Not entirely sure whether this should be here or at webshim (I'll copy the issue in both). Here it is at the webcomponents.js repo https://github.com/webcomponents/webcomponentsjs/issues/255

This is a webcomponents issue, just run this code, with and without webcomponents:
<form id="form" class="ws-validate">
	<input required=""  />
	<input type="submit" />
</form>
<script>
	$(document).on('special', function(){
		console.log('document');
	});
	$(document.body).on('special', function(){
		console.log('body');
	});
	$('form').on('special', function(){
		console.log('form');
	});
	$('input').eq(0).trigger('special');
</script>

thanks!


Feature/version change fix

Fixes the version change not updating the files (a better fix is to put the version in the state).
Fixes the parameters being swapped again for add workflow test parameter files and added a test for it (previously only the tool one was fixed and tested)

@garyluu is there a ticket for this (for changelog writing purposes)

no ticket for this, wasn't broken in production


issues uploading certain image files

When uploading .bmp files, we get the exception message  `Unsupported image type. GD driver is only able to decode JPG, PNG, GIF or WebP files' which is self explanatory.
We should check the file type and only optimize files in the above white-list.

this has been addressed in commit 22a891044dd10eaa0158250c10e0d4f461364b5d


Sampling for sensitivity analysis on Euler is broken

The new database structure introduced in #549 is not compatible with the sampling code in Euler, generating the following error:
Creating samples morris 10
Traceback (most recent call last):
  File "/cluster/apps/python/2.7.6/x86_64/lib64/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/cluster/apps/python/2.7.6/x86_64/lib64/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/cluster/home/martinmo/CEAforArcGIS/cea/analysis/sensitivity/sensitivity_demand_samples.py", line 149, in <module>
    sampler_parameters=sampler_params)
  File "/cluster/home/martinmo/CEAforArcGIS/cea/analysis/sensitivity/sensitivity_demand_samples.py", line 73, in create_demand_samples
    pdf = pd.concat([pd.read_excel(locator.get_uncertainty_db(), group, axis=1) for group in variable_groups])
  File "/cluster/apps/python/2.7.6/x86_64/lib64/python2.7/site-packages/pandas-0.16.1-py2.7-linux-x86_64.egg/pandas/io/excel.py", line 151, in read_excel
    return ExcelFile(io, engine=engine).parse(sheetname=sheetname, **kwds)
  File "/cluster/apps/python/2.7.6/x86_64/lib64/python2.7/site-packages/pandas-0.16.1-py2.7-linux-x86_64.egg/pandas/io/excel.py", line 287, in parse
    **kwds)
  File "/cluster/apps/python/2.7.6/x86_64/lib64/python2.7/site-packages/pandas-0.16.1-py2.7-linux-x86_64.egg/pandas/io/excel.py", line 403, in _parse_excel
    sheet = self.book.sheet_by_name(asheetname)
  File "/cluster/home/martinmo/.local/lib64/python2.7/site-packages/xlrd/book.py", line 441, in sheet_by_name
    raise XLRDError('No sheet named <%r>' % sheet_name)
xlrd.biffh.XLRDError: No sheet named <'THERMAL'>

I'm using the old uncertainty database on Euler for now, but the sensitivity analysis code for Euler should be adapted to the new database structure... @daren-thomas?


Adds AzureOpenAI to DialogInputType and makes botAppId optional

Contributing to the Azure SDK
Please see our CONTRIBUTING.md if you are not familiar with contributing to this repository or have questions.
For specific information about pull request etiquette and best practices, see this section.

API change check
APIView has identified API level changes in this PR and created following API reviews.
Azure.Communication.CallAutomation


add draft of man page

Here is the little man page I wrote using the doc macros (see mdoc(7)). CONFIGURATION is still missing some parts.

Thanks.  I've two things to do: #18, and I've to update the docs.  Then this pr can get ready to be merged.

grouped flags support is done

@gogitops thanks for the report, but it is not relevant to this PR.  The golint warnings will be fixed, but can't promise for cyclomatic complexity.


Not working on my Device (iPhone 5c)

First, let me say that this is a cool library. I have pod installed it and the whole thing works fine in a simulator. But when I try to run it on iPhone 5c (the actual device), I'm getting a swift compile error saying "no such module exists" for the line 'import SmileLock'.
Please help. Thanks in advance.

Dont know why, but for some reason the line " pod 'SmileLock' " was not enough to run the app on device. HAd to manually put the folder of SmileLock and type in " pod 'SmileLock', :path => "../" " in the podfile and then it began to work in the device(5c).


feat: prerequisites for widget components

These are some preliminary changes that are needed for widgets and to make it easier for Lean to process where the infoview the user has clicked. There will be another PR with the widget and context suggestion code itself.
Also note that while this PR doesn't break the vscode-lean4 extension it does cause inaccessible hypotheses to be rendered as [anonymous] instead of as just an empty space. I have a fix for this that I will PR over there.
changes in this pr

InteractiveHypothesis now has fvarIds? field and InteractiveGoal now has a mvarId? field. This is so that goals and hypotheses in a goal can be uniquely referenced across RPC boundary.
The way in which InteractiveHypothesis handles inaccessible names has changed. These are now represented as Name.anonymous instead of an empty array. This is so that the size of fvarIds? and names is always equal.
refactor goalToInteractive to use for loop instead of fold
rename exprToInteractive → ppExprTagged
add an RPC Lean.Widget.ppExprTagged

The PR adds a new ExprWithCtx type without any way to construct it (from the RPC side).  What are your plans for the API with this type?  I'm a bit concerned that we're accumulating lots of incompatible single-purpose types, which apparently cannot be reused easily.
For example we now have InfoWithCtx and ExprWithCtx that contain essentially the same information (a subexpression).  And we already have a pretty-printing function for InfoWithCtx.  And I can get the type of an InfoWithCtx (only as text though), but not of an ExprWithCtx.

I'm a bit concerned that we're accumulating lots of incompatible single-purpose types, which apparently cannot be reused easily.

I also tried the generic
structure WithCtx (α) where
  lctx : LocalContext
  ctx : ContextInfo
  val : α

but it is not really better because

Elab.Info already has a LocalContext, so we would duplicate it.
A blanket instance WithRpcRef (WithCtx α) is unsound. Any given WithRpcRef instance has an associated typeName which is checked when an RPC pointer is received, so a single such instance would accept any WithCtx α in place of any other WithCtx β. To avoid that we end up having to write deriving instance RpcEncoding with {withRef := true} for WithCtx Expr, and deriving ... WithCtx Info.

So I share your concern about duplication, but I was unfortunately not able to make the API better - do you have an idea of how to do so?

The PR adds a new ExprWithCtx type without any way to construct it (from the RPC side). What are your plans for the API with this type?

It is not hard to construct. Here is an example from a commutative diagram demo I am working on.
The plan is to make InteractiveExpr as defined here work, for example in the JS part of the diagram demo here.

For example we now have InfoWithCtx and ExprWithCtx that contain essentially the same information (a subexpression).

They are not really the same thing. An Elab.Info can be many things - .ofTermInfo is only one case. We could use .ofTermInfo to send expressions around but that seems hacky, in particular because every .ofTermInfo has an associated elaborator and AST, whereas not every expression does.
The purpose of InfoWithCtx is to carry over information about delaborated Info nodes in a CodeWithInfos, and the associated pretty-printing functionality is purpose-specific to showing the contents of infoview popups.
The purpose of ExprWithCtx is so that widget writers can send an expression over and display it, as well as send it back in another RPC call for further processing. The former functionality can be achieved by sending CodeWithInfos, and even the latter could by inspecting the root tag for its .ofTermInfo. However ExprWithCtx gives a cleaner interface, and it gives the option to not pretty-print the expression, which can be useful if the widget code just needs it around as data, or wants to delay printing until the user requests it.

Also note that while this PR doesn't break the vscode-lean4 extension it does cause inaccessible hypotheses to be rendered as [anonymous] instead of as just an empty space. I have a fix for this that I will PR over there.

It is not hard to construct. Here is an example from a commutative diagram demo I am working on.

I didn't doubt for a second that you can construct an ExprWithCtx from the Lean side.  (Though looking at the diagram code, a ExprWithCtx.withCtx : Expr → MetaM ExprWithCtx function might be a useful abstraction.)  What I referred to was that there is no RPC function which returns an ExprWithCtx.
So if I understand your response correctly: there are no immediate plans to use ExprWithCtx for any built-in functionality; the ppExprTagged function is only there as a helper function for external widgets?

I also tried the generic [WithCtx (α)]

The only thing a generic wrapper would help with is the Lean side, which I think is fine right now.  My concern about duplication was about the RPC side: that functions like getGoToDefinition, ppExprTagged, etc., only work with one kind of subexpression, but not the other.  Maybe we're just missing InfoWithCtx.getExpr? and ExprWithCtx.toInfo functions though.

[InfoWithCtx and ExprWithCtx] are not really the same thing.

I was being a bit hyperbolic: the implementation and underlying data structures are of course different.  But as far as the infoview is concerned, the .ofTermInfo case is the only one that is relevant.  (I don't think .ofFieldInfo is used at all, it has some non-interactive fallback code that I have never seen in action.)  So in practice, we could replace InfoWithCtx by ExprWithCtx without any loss in functionality.
Maybe part of my irritation is because Elab.Info is not at all the information we want to show as a popup.  Some cases like .ofCompletionInfo don't make sense at all to show in a popup.  And something like .ofMacroExpansionInfo would be shown together with the term information (so one popup would correspond to more than one Elab.Info).  On the UI side you select a subexpression, not an info node (because there can be many info nodes with the same range).
But that's unproductive rambling.  Perhaps it's best if I just think of InfoWithCtx as InfoPopupThunk.

I can rename InfoWithCtx as InfoPopupThunk? I'll add a docstring explaining the difference anyway.

@Vtec234 I couldn't find an example of using InfoWithCtx outside of SubexprInfo, and InfoWithCtx is an opaque reference to vscode. Maybe it could be replaced with ExprWithCtx?

I couldn't find an example of using InfoWithCtx outside of SubexprInfo, and InfoWithCtx is an opaque reference to vscode. Maybe it could be replaced with ExprWithCtx.

A priori, I am not opposed to this refactor if it makes the API cleaner. But it would be a breaking change to the RPC API, unless we want to keep calling the function ExprWithCtx -> CodeWithInfos infoToInteractive. One option would be to make a new function, bump the server version to indicate that new APIs exist, but keep the old name around for a while for backwards compatibility.

I did not want to suggest any big refactorings for this PR.  If we merge InfoWithCtx and ExprWithCtx now, then we should stick with the infoToInteractive name for compatibility.  (There's also an info field name in SubexprInfo, BTW.)
Once we do a bigger refactoring and bump the server version, we should first a) decide on #1176 and b) figure out where to put the semantic highlighting information.  The latter might require some incompatible changes in the CodeWithInfos type as well.

We are going to remove ExprWithCtx for now and we will figure out what to do with it. So this PR becomes just about contextual suggestions.


Remove WidgetTester.pumpWidgetLegacy()

The implementation of WidgetTester.pumpWidget was changed in https://github.com/flutter/flutter/pull/48922 and the old implementation was moved to WidgetTester.pumpWidgetLegacy.
There are a few tests in packages/flutter/test/material/text_field_test.dart that are still using pumpWidgetLegacy because they fail with pumpWidget. We need to investigate the failures and move them to pumpWidget.

I didn't found any reference of pumpWidgetLegacy on the file mentioned. Is this still a valid issue?
https://github.com/flutter/flutter/blob/master/packages/flutter/test/material/text_field_test.dart

Closing since there doesn't seem to be anything left in the codebase that uses pumpWidgetLegacy


[SPARK-28708][SQL] IsolatedClientLoader will not load hive classes from application jars on JDK9+

What changes were proposed in this pull request?
We have 8 test cases in HiveSparkSubmitSuite still fail with java.lang.ClassNotFoundException when running on JDK9+:
[info] - SPARK-18989: DESC TABLE should not fail with format class not found *** FAILED *** (9 seconds, 927 milliseconds)
[info]   spark-submit returned with exit code 1.
[info]   Command line: './bin/spark-submit' '--class' 'org.apache.spark.sql.hive.SPARK_18989_CREATE_TABLE' '--name' 'SPARK-18947' '--master' 'local-cluster[2,1,1024]' '--conf' 'spark.ui.enabled=false' '--conf' 'spark.master.rest.enabled=false' '--jars' '/root/.m2/repository/org/apache/hive/hive-contrib/2.3.6-SNAPSHOT/hive-contrib-2.3.6-SNAPSHOT.jar' 'file:/root/opensource/spark/target/tmp/spark-36d27542-7b82-4962-a362-bb51ef3e457d/testJar-1565682620744.jar'
[info]
[info]   2019-08-13 00:50:22.073 - stderr> WARNING: An illegal reflective access operation has occurred
[info]   2019-08-13 00:50:22.073 - stderr> WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/root/opensource/spark/common/unsafe/target/scala-2.12/classes/) to constructor java.nio.DirectByteBuffer(long,int)
[info]   2019-08-13 00:50:22.073 - stderr> WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
[info]   2019-08-13 00:50:22.073 - stderr> WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[info]   2019-08-13 00:50:22.073 - stderr> WARNING: All illegal access operations will be denied in a future release
[info]   2019-08-13 00:50:28.31 - stderr> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/metadata/HiveException
[info]   2019-08-13 00:50:28.31 - stderr> 	at java.base/java.lang.Class.getDeclaredConstructors0(Native Method)
[info]   2019-08-13 00:50:28.31 - stderr> 	at java.base/java.lang.Class.privateGetDeclaredConstructors(Class.java:3138)
[info]   2019-08-13 00:50:28.31 - stderr> 	at java.base/java.lang.Class.getConstructors(Class.java:1944)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:294)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:410)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:305)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveExternalCatalog.client$lzycompute(HiveExternalCatalog.scala:68)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveExternalCatalog.client(HiveExternalCatalog.scala:67)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveExternalCatalog.$anonfun$databaseExists$1(HiveExternalCatalog.scala:221)
[info]   2019-08-13 00:50:28.31 - stderr> 	at scala.runtime.java8.JFunction0$mcZ$sp.apply(JFunction0$mcZ$sp.java:23)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:99)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveExternalCatalog.databaseExists(HiveExternalCatalog.scala:221)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.internal.SharedState.externalCatalog$lzycompute(SharedState.scala:139)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.internal.SharedState.externalCatalog(SharedState.scala:129)
[info]   2019-08-13 00:50:28.31 - stderr> 	at org.apache.spark.sql.hive.HiveSessionStateBuilder.externalCatalog(HiveSessionStateBuilder.scala:42)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.hive.HiveSessionStateBuilder.$anonfun$catalog$1(HiveSessionStateBuilder.scala:57)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.catalyst.catalog.SessionCatalog.externalCatalog$lzycompute(SessionCatalog.scala:91)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.catalyst.catalog.SessionCatalog.externalCatalog(SessionCatalog.scala:91)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.catalyst.catalog.SessionCatalog.databaseExists(SessionCatalog.scala:244)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.catalyst.catalog.SessionCatalog.requireDbExists(SessionCatalog.scala:178)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.catalyst.catalog.SessionCatalog.createTable(SessionCatalog.scala:317)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.command.CreateTableCommand.run(tables.scala:132)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:79)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.Dataset.$anonfun$logicalPlan$1(Dataset.scala:213)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.Dataset.$anonfun$withAction$1(Dataset.scala:3431)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$4(SQLExecution.scala:100)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:160)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:87)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3427)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.Dataset.<init>(Dataset.scala:213)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:95)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:653)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.hive.SPARK_18989_CREATE_TABLE$.main(HiveSparkSubmitSuite.scala:829)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.hive.SPARK_18989_CREATE_TABLE.main(HiveSparkSubmitSuite.scala)
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:920)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:179)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:202)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:89)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:999)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1008)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
[info]   2019-08-13 00:50:28.311 - stderr> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.metadata.HiveException
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:471)
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:588)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.doLoadClass(IsolatedClientLoader.scala:250)
[info]   2019-08-13 00:50:28.311 - stderr> 	at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.loadClass(IsolatedClientLoader.scala:239)
[info]   2019-08-13 00:50:28.311 - stderr> 	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
[info]   2019-08-13 00:50:28.311 - stderr> 	... 48 more

Note that this pr fixes java.lang.ClassNotFoundException, but the test will fail again with a different reason, the Hive-side java.lang.ClassCastException which will be resolved in the official Hive 2.3.6 release.
[info] - SPARK-18989: DESC TABLE should not fail with format class not found *** FAILED *** (7 seconds, 649 milliseconds)
[info]   spark-submit returned with exit code 1.
[info]   Command line: './bin/spark-submit' '--class' 'org.apache.spark.sql.hive.SPARK_18989_CREATE_TABLE' '--name' 'SPARK-18947' '--master' 'local-cluster[2,1,1024]' '--conf' 'spark.ui.enabled=false' '--conf' 'spark.master.rest.enabled=false' '--jars' '/Users/dongjoon/.ivy2/cache/org.apache.hive/hive-contrib/jars/hive-contrib-2.3.5.jar' 'file:/Users/dongjoon/PRS/PR-25429/target/tmp/spark-48b7c936-0ec2-4311-9fb5-0de4bf86a0eb/testJar-1565710418275.jar'
[info]
[info]   2019-08-13 08:33:39.221 - stderr> WARNING: An illegal reflective access operation has occurred
[info]   2019-08-13 08:33:39.221 - stderr> WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/Users/dongjoon/PRS/PR-25429/common/unsafe/target/scala-2.12/classes/) to constructor java.nio.DirectByteBuffer(long,int)
[info]   2019-08-13 08:33:39.221 - stderr> WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
[info]   2019-08-13 08:33:39.221 - stderr> WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[info]   2019-08-13 08:33:39.221 - stderr> WARNING: All illegal access operations will be denied in a future release
[info]   2019-08-13 08:33:43.59 - stderr> Exception in thread "main" org.apache.spark.sql.AnalysisException: java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap');
[info]   2019-08-13 08:33:43.59 - stderr> 	at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:109)

How was this patch tested?
manual tests:

Install Hive 2.3.6-SNAPSHOT to local maven repository:

mvn clean install -DskipTests=true

Upgrade our built-in Hive to 2.3.6-SNAPSHOT, you can checkout this branch to test.
Test with hadoop-3.2:

build/sbt "hive/test-only *. HiveSparkSubmitSuite" -Phive -Phadoop-3.2 -Phive-thriftserver
...
[info] Run completed in 3 minutes, 8 seconds.
[info] Total number of tests run: 11
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 11, failed 0, canceled 3, ignored 0, pending 0
[info] All tests passed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14094/
Test PASSed.

Test build #109029 has started for PR 25429 at commit cab0590.

Test build #109029 has finished for PR 25429 at commit cab0590.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109029/
Test PASSed.

@wangyum . Did I miss something you did? I downloaded and rebased to the master.
This PR still fails on both hadoop-2.7 and hadoop-3.2 profile like the followings on JDK11.
$ build/sbt -Phive "hive/testOnly *.HiveSparkSubmitSuite"
[info] Tests: succeeded 3, failed 8, canceled 3, ignored 0, pending 0
[info] *** 8 TESTS FAILED ***
[error] Failed: Total 11, Failed 8, Errors 0, Passed 3, Canceled 3
[error] Failed tests:
[error] 	org.apache.spark.sql.hive.HiveSparkSubmitSuite
[error] (hive/test:testOnly) sbt.TestsFailedException: Tests unsuccessful
[error] Total time: 148 s, completed Aug 13, 2019, 8:28:58 AM

$ java -version
openjdk version "11.0.3" 2019-04-16
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.3+7)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.3+7, mixed mode)

cc @dbtsai

Interesting, that's a different error. I wonder if we could see the stack trace of the cause, whether it comes from Spark or Hive. I had the impression that these error were ultimately from the Hive code, when I looked into it, but maybe not in this case.

I thought like that, too. @srowen . I believe @wangyum seems to have a fixed Hive library which will be Hive 2.3.6 (from Hive dev mailing list).

@dongjoon-hyun Did you upgraded built-in Hive to 2.3.6-SNAPSHOT?

Install Hive 2.3.6-SNAPSHOT to local maven repository:

mvn clean install -DskipTests=true

Upgrade our built-in to 2.3.6-SNAPSHOT, you can checkout this branch to test.
Test with hadoop-3.2:

build/sbt "hive/test-only *. HiveSparkSubmitSuite" -Phive -Phadoop-3.2 -Phive-thriftserver

Thank you, @wangyum . Could you put that into the PR description?

Ur, by the way, you are pointing your repository.

https://github.com/wangyum/hive/tree/HIVE-21584-branch-2.3

Hmm. Wait for a second. In this case, shall we proceed in this way, @wangyum and @srowen ?

We cannot install that one in our Jenkins environment. Jenkins will still fail without official Hive 2.3.6.
And, it's clear that this PR resolve the existing issue and now we are hitting Hive issue.
So, update the PR description about this and merge the current patch.

Test build #109049 has started for PR 25429 at commit 103e7a1.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/14111/
Test PASSed.

Yeah fine to merge this as it gets closer to resolving the issue, even though it won't fully resolve it.

Test build #109049 has finished for PR 25429 at commit 103e7a1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/109049/
Test PASSed.


[Feature(s) Request] look comment for detail

I want some new features bc it's even more thin than other wms which mean I can't do something in
this wm,but I still love this wm
1 . Move a window to another workspace(wormc)
for example:
in sxhkd:
super + shift + {1,2,3,4,5}
wormc mv (focused) (workspace){1,2,3,4,5}
2 . Resize window without meed to drag the border but the corner of window like bspwm does(not a wm hopping)
2 . Change focus of window by moving mouse without click
3 . Change focus of window by keybinding
for example;
in sxhkd:
super + {w,a,s,d}
wormc mvfocus {north,west,south,east}
4 . Fix Worm restart issue,for example:use worm -r or wormc -r instead of worm because it actually doesn't restart but starts a new process
5 . Be able to add a new workspace
for example,I want to set 5 workspaces;
in rc:
wormc set workspaces: 1 2 3 4 5

(1): already exists, see wormc move-tag
(2): you can use alt-drag / super-drag depending on configuration, but I don't plan to add the complicated resize mechanism used by other WMs because it's too much code.
(2) (you made two 2s): exists, see wormc focus-mode
(3): maybe I guess this could be done, but also can be done with other tools like xdotool + sxhkd, worm tries to keep it's codebase minimal
(4) a restart command is definitely useful but until then you can alias restart_worm to killall worm;worm
(5) fair complaint, but it requires using a dynamic array instead of a stack-allocated buffer(more inefficient and more code), so I think for the few people that aren't fine with 9 workspaces you can change it manually in the code but I will try to implement this in future.
thanks!


Add key/value end to end test

Adds a test case to test the functionality of the key/value Rust SDK. The test checks both inter and intra request key/value actions.
Also, updated some of the README with the latest test suite changes and added ability to test http requests of all methods (not just GET).

Hi @kate-goldenring i have merged this PR as there is a pending PR I need to rebase with changes done here.


Fix the check of DAC & CoreCLR versions when they are not versioned

Fixes #929

@leculver Friendly ping.

Hello!
I have been on vacation for the past two weeks.  I unfortunately forgot to set a GitHub away message.  I will take a look at this early next week as I'm just back into the office today and have a lot of meetings.


Ability to provide version to publish

We have a use case where we want to add CI/CD for internal feature development. As part of this, we want to allow developers developing features to publish "snapshot" versions for them to test in production. We also want to tie release builds to the commit they were built on.
Currently, it seems features have a hard requirement around semver versioning which makes this tricky for CI/CD to easily version. Ideally, we could call publish passing in the version to use which could be a short commit sha to use for the feature version.
Curious to hear if the semver requirement is needed or whether this can be relaxed to allow a version flag to be passed to publish to allow custom tagging/versioning of features.
Happy to submit a PR, but wanted to get some clarification around this use case before diving in.

Thanks for opening! I'd be curious to get @samruddhikhandale and @joshspicer's thoughts here.

Hi 👋
Thanks for the detailed ask in here.

Curious to hear if the semver requirement is needed or whether this can be relaxed to allow a version flag to be passed to publish to allow custom tagging/versioning of features.

Features spec was mainly created with production use in mind. However, for your use case, where you want to publish "snapshot" versions tied to a specific commit for internal testing, semver might seem restrictive. One common approach to handle this scenario is to use pre-release versions as defined by semver. You can append a hyphen and an identifier to your version number (e.g., 1.0.0-abcdef1 where abcdef1 is the short commit SHA). This allows you to keep the benefits of semver while also tying the version to a specific commit.
Let us know if that ^ was helpful in your case.

Hey @samruddhikhandale , sorry for the delay, catching up from some time off. That actually would be perfect, would it make sense to have a flag as part of publish that allows us to publish the features postfixed with a dash and the provided value (which we could use to provide the short commit sha)?
Alternatively we could script a way to update the version to have that postfix, but this seems generic enough to be incorporated.

That actually would be perfect, would it make sense to have a flag as part of publish that allows us to publish the features postfixed with a dash and the provided value (which we could use to provide the short commit sha)?

I believe we currently allow publishing a postfix with dash versions, however, can you try and let us know if it's working?

That is correct, I'm checking if we can add an argument to the publish command line options to allow specifying the postfix. Such that the version specified in the feature json can be static, and the command line appends the postfix during build/publish in order to keep the CI simple (instead of creating logic to update the files before running publish)

@samruddhikhandale checking back, we're happy to implement the ability to provide a version postfix to the command line arguments as a PR, but want to confirm that is a reasonable thing to implement

We are using GitVersion for creating snapshots and when we get versions like: "1.0.39-build-conan-feature.1+7" it works to publish it. BUT this also publishes it to:
[13916 ms] Tagged: 1 -> xxx
[14179 ms] Tagged: 1.0 -> xxx
[14499 ms] Tagged: 1.0.39-build-conan-feature.1+7 -> xxx
[14788 ms] Tagged: latest -> xxx

That is not what I want for a snapshot! It would be nice if I could have a either an explicit --snapshot-version=1.0.39-build-conan-feature.1+7 that disables tagging fror major, minor and latest, or an implicit feature that disables tagging for snapshots.


Issue with :react-native-vector-icons'

How to resolve the below issue
My app is developed on react-native framework
FAILURE: Build failed with an exception.

What went wrong:
A problem occurred configuring project ':app'.

Could not resolve all dependencies for configuration ':app:_debugApk'.
A problem occurred configuring project ':react-native-vector-icons'.
No toolchains found in the NDK toolchains folder for ABI with prefix: mips64el-linux-android

Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

Get more help at https://help.gradle.org

BUILD FAILED in 5s
Could not install the app on the device, read the error above for details.
Make sure you have an Android emulator running or a device connected and have
set up your Android development environment:
https://facebook.github.io/react-native/docs/android-setup.html

I had the same issue as you. The changes I made were:
android/build.gradle:
dependencies {
-classpath 'com.android.tools.build:gradle:2.3.3'
+classpath 'com.android.tools.build:gradle:3.3.0-alpha05'

ext {
-buildToolsVersion = "26.0.3"
+buildToolsVersion = "28.0.2"

and in android/gradle/wrapper/gradle-wrapper.properties:
-distributionUrl=https\://services.gradle.org/distributions/gradle-3.5.1-all.zip
+distributionUrl=https\://services.gradle.org/distributions/gradle-4.9-all.zip

And then it built for me. I found the instructions here: https://github.com/google/filament/issues/15 for the build.gradle changes and then followed the error message prompts to fix gradle-wrapper.properties.

You want me to  update the buildToolsVerison = '28.0.2' in  android/app/build.gradle file
currently my file is

You want me to update the buildToolsVerison = '28.0.2' in android/app/build.gradle file

same error @TimmeeG  thanks but your solution doesn't work for me


--skipCommit doesn't add tag on latest commit

I have a project with several versioned apps and feature modules contained in libraries:
apps/
- app1/
- app2/
libs/
- app1-ui/
- app2-ui/

Apps have version targets with these configs:
{
  "push": true,
  "skipCommit": true,
  "preset": "conventional",
  "baseBranch": "HEAD:main",
  "trackDeps": true,
  "allowEmptyRelease": true
}

Libraries do not have the version target.
If I make changes to files in app1-ui/, e.g.:
libs/
  - app1-ui/
    - src/
      - lib/
        - index.ts

Nx detects that app1-ui and app1 are affected and CI jobs are ran.
When changes are merged to main, nx affected --target=version --parallel=1 runs as part of CD to create tags for affected projects.
However, newly generated tags are only being applied to last commits that contain direct changes to affected projects. For example, if the above change made to app1-ui is merged to main with this history:
ab670192 fix: update index.ts file in app1-ui/ <-- new commit
70192fa8 refactor: unrelated commit
9e598fa8 feat: update all app project.json files with version target (tags: app1-0.1.0, app2-0.1.0)

New tag that is calculated for app1, app1-0.1.1, and is being applied to commit 9e598fa8 instead of commit ab670192:
ab670192 fix: update index.ts file in app1-ui/ <-- new commit
70192fa8 refactor: unrelated commit
9e598fa8 feat: update all app project.json files with version target (tags: app1-0.1.0, app2-0.1.0, app1-0.1.1) <-- new tag add to this

It seems like this is happening because commit 9e598fa8 contains direct changes to project app1.
I was expecting that the last tag would be applied to commit ab670192 instead:
ab670192 fix: update index.ts file in app1-ui/ (tags: app1-0.1.1)
70192fa8 refactor: unrelated commit
9e598fa8 fix: update all app project.json files with version target (tags: app1-0.1.0, app2-0.1.0)

Is this expectation correct and if not, is there an option to tag latest commits instead of latest commits with direct project changes?

I'm running into the same issue -- this behavior was a bit unexpected and caused a production issue.

@edbzn is there any progress on this? Any chance it was resolved in v3?

@paytonagreen @timurongh any tips on how to get around this issue?


[FEATURE] Logging requests to the LLM using OllamaChatModel

Hi all.
I think that there is no way to capture the requests and response logs using Ollama.
https://docs.langchain4j.dev/tutorials/logging
thanks

Hey, there is a PR already: https://github.com/langchain4j/langchain4j/pull/662

Closing this issue as it was implemented in #662


Enum com.microsoft.aad.msal4j.Prompt lacks a "none" option

I am missing the option "none" in the enum com.microsoft.aad.msal4j.Prompt, I would like to use it in AuthorizationRequestUrlParameters to request a silent login

Hello @mkropf : Could you describe your use case a bit? Typically, if you want to send a silent request you should make a silent flow call with acquireTokenSilently, and if that fails fall back to some interactive flow.
However, the silent flow only works if you already have a token to return/refresh, but if I understand it right you want to send 'none' to try to do that first interactive call without user interaction?

Hi @Avery-Dunn, you guessed it, I would like to make use of the "keep me signed in" options of MS login. The plan is, my server redirects the client to login with prompt "none" first and only if that fails it redirects the client to login with "select_account"

after all, "none" is a valid prompt option in MS identity platform so I would expect it in the enum type too

Sorry for the delay on this, but for anyone who needs the 'none' prompt it was addressed in https://github.com/AzureAD/microsoft-authentication-library-for-java/pull/504, and was added as part of the recent 1.12.0 release.


Kilo Backport of Ceph Support

Add ELK support for Ceph
Add logstash template file for ceph. Add a beaver ceph.conf file for ceph
containers and hosts.
Due to the permissions on /var/log/ceph.log and /var/log/ceph-audit.log it
isn't possible to capture these at this point, and Ceph offers no otpions
to adjust this, so we will need an alternative solution for this. This
applies to the mons only.
(cherry picked from commit ba024a7a704dc1d5089e778952b629668f9365bc)
Ceph monitoring
This commit adds the following functionality:

A new plugin for use in monitoring a ceph cluster
An Ansible library for gathering OSD-host facts
Updates to the setup-maas.yml playbook and rpc_maas role to deploy
and configure the ceph_monitoring.py plugin.

Co-Authored-By: Matt Thompson<EMAIL_ADDRESS>Co-Authored-By: Hugh
Saunders<EMAIL_ADDRESS>(cherry picked from commit 29e2fdd5fe51dd20b5982eac7342dc770b048183)
Add Ceph support
This commit adds support for deploying a Ceph cluster using rpc-openstack
as well setting the appropriate configuration for integration with
os-ansible-deployment's Ceph capabilities.
This commit makes use of the following roles to deploy a Ceph cluster:
https://github.com/ceph/ansible-ceph-common
https://github.com/ceph/ansible-ceph-mon
https://github.com/ceph/ansible-ceph-osd
The roles are submodules and so should get automatically cloned at the same
time as os-ansible-deployment.
The default configuration is designed to deploy three mon containers, one
on each controller, with separate physical hosts for OSDs.
The Ceph pools and users required by OpenStack are automatically created as
part of the setup.
Ceph can be deployed on a AIO, when this is done three OSD containers are
created in an attempt to provide a more realistic representation of a Ceph
cluster.
The rbd pool is created automatically when a new Ceph cluster is deployed.
This pool is not used by an OpenStack deployment but does consume pgs and
so is removed if it exists and is empty.
This commit sets the following in user_extras_variables.yml:
pool_default_size: 3 pool_default_min_size: 2 mon_osd_full_ratio: .90
mon_osd_nearfull_ratio: .80 raw_multi_journal: true journal_size: 80000
secure_cluster: true secure_cluster_flags:

nodelete

The role defaults are:
pool_default_size: 2 pool_default_min_size: 1 mon_osd_full_ratio: .95
mon_osd_nearfull_ratio: .85 raw_multi_journal: false journal_size: 0
secure_cluster: false secure_cluster_flags:

nopgchange
nodelete
nosizechange

The Ceph playbooks have been excluded from ansible-lint because their
inclusion causes the third-party Ceph roles to be tested and they fail the
ansible-lint checks.
Co-Authored-By: git-harry<EMAIL_ADDRESS>(cherry picked from commit 3b7dd22ba1de0da355b9e64910dd9925fb8a0c85)

This is the backport, needed to tag an r11.1.0rc1. :+1:


Some DMG games use bad CGB colors

When using the online ROM builder, I loaded the BIOS files first before loading any games. However some of the DMG games are detected (possibly incorrectly) to use the CGB bios.
This seems to mess up the color palettes in some games, and many of these predate CGB so don't have any real support for it. Here are some screenshots from cen64:
Donkey Kong Land

Kirby's Dream Land

Adventure Island

Also I tried building this game without specifying BIOS - it doesn't display any graphics.
Adventure Island II

Another Bible (J)

Battletoads in Ragnarok's World

I found the issue and it has been fixed


refactor(ast): add span field to the BindingPattern type.

#3855  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @rzvxa and the rest of your teammates on  Graphite


Fix variable name in the pattern match.

I'm walking through this excellent example and learned a lot. Thanks for your work.
fnDefByName = [f | f@(Function { name = nm }) <- globalDefs]

I believe name in the pattern will catch the value, not match the value , and  this expression want to filter all the function that matches the name.
Here is the test that verified my thought.
data Test = Test {key::String} deriving Show
testList = [Test "a", Test "b", Test "c"]
filterKey = "a"
tryFiltered = [f | f@(Test filterKey) <- testList]
realFiltered = [f | f@(Test filterKey') <- testList, filterKey' == filterKey]

λ> testList
[Test {key = "a"},Test {key = "b"},Test {key = "c"}]
λ> tryFiltered
[Test {key = "a"},Test {key = "b"},Test {key = "c"}]
λ> realFiltered
[Test {key = "a"}]

This makes sense, thanks.


Added new community app wsonedevices

New app - WSONEDevicesP
Description
Replace this with a description of your changes.
Copilot

copilot:all

I have read the CLA Document and I hereby sign the CLA


StoreOptions.DdlRules.Role not being used

In postgres the default owner of a new object is the user or role of the session. Executing the following code block in pgAdmin 4 demonstrates this concept (assuming you're connected under the postgres user):
CREATE ROLE TestRole;
GRANT TestRole TO postgres;

SET ROLE TestRole;

CREATE TABLE TestTable(id int);

SELECT
	r.rolname
FROM
	pg_class AS rel
	INNER JOIN pg_roles AS r ON r.oid = rel.relowner
WHERE
	rel.relname = 'testtable'

Note that the displayed owner of the relation is "TestRole" instead of "postgres", even though we initially connected with the postgres user.
The Role property on the DdlRules object (found as a property by the same name on the StoreOptions class) says that you should set it to "... use this database role during DDL scripts". However, that role doesn't seem be respected when Marten creates underlying tables, as demonstrated by this failing test:
using Marten;
using Npgsql;
using System;
using System.Threading.Tasks;
using Xunit;

namespace MartenTest
{
    public class ClassToStore
    {
        public Guid Id { get; set; }
    }

    public class SetsOwnerToSpecifiedRole
    {
        private const string ConnectionString = "Server=localhost; Database=postgres; User Id=postgres; Password=postgres;";
        private const string TestRole = "TestOwnershipRole";

        [Fact]
        public async Task Test()
        {
            using(var connection = new NpgsqlConnection(ConnectionString))
            {
                await connection.OpenAsync();

                using(var command = connection.CreateCommand())
                {
                    command.CommandText = $"CREATE ROLE {TestRole}";

                    try
                    {
                        await command.ExecuteNonQueryAsync();
                    }
                    catch (PostgresException exception) when (exception.SqlState == "42710") { }

                    command.CommandText = $"GRANT {TestRole} TO postgres";
                    await command.ExecuteNonQueryAsync();

                    command.CommandText = "DROP TABLE IF EXISTS mt_doc_classtostore";
                    await command.ExecuteNonQueryAsync();
                }
            }

            var options = new StoreOptions();
            options.Connection(ConnectionString);
            options.DdlRules.Role = TestRole;

            using(var documentStore = new DocumentStore(options))
            {
                using(var session = documentStore.OpenSession())
                {
                    session.Store(new ClassToStore());
                    await session.SaveChangesAsync();
                }
            }

            using(var connection = new NpgsqlConnection(ConnectionString))
            {
                await connection.OpenAsync();

                using(var command = connection.CreateCommand())
                {
                    command.CommandText = @"
SELECT
	r.rolname
FROM
	pg_class AS rel
	INNER JOIN pg_roles AS r ON r.oid = rel.relowner
WHERE
	rel.relname = 'mt_doc_classtostore'";

                    var owner = (string)(await command.ExecuteScalarAsync());

                    Assert.Equal(TestRole, owner);
                }
            }
        }
    }
}

Per a conversation in gitter, this bug needs to be addressed with a pull request. Closing the ticket.


How to search and jump to IDs in HTML?

I tried Cmd-Shift-R, but that didn't seem to find this in my current HTML file:
<section id="dropin">
  ...
</section>

I can't seem to figure it out from the documentation.

You might have better luck asking in the Atom support forum here – generally support questions are a better fit for Atom Discuss than GitHub Issues.

Ah, sorry. Thanks!


[1881] Fix markup on results pages

Context
https://trello.com/c/mBUxbYhP/1881-s-non-javascript-lead-school-search-the-or-is-weirdly-placed-is-it-using-the-formbuilder
For both lead schools and employing schools results partial
Changes proposed in this pull request
Formbuilder was being used but uses of gov css margin override classes was making it look weird and not like the prototype
css classes removed and some markup added to make it look more like the prototype
Guidance to review
Turn js off and search for schools on lead schools edit and employing schools edit page

 [S] Non-javascript lead school search the 'or' is weirdly placed. Is it using the formbuilder?


fix load_optimizer_states for MoE (#2737)

When load_optimizer_states=False is used for MoE load_checkpoint - do not attempt to load the optimizer state files.
This currently fails as DeepSpeed still attempts to load those, even though they are not used afterwards.
Adding parameterized unit tests for various cases.
Verified via: pytest tests/unit/checkpoint/test_moe_checkpoint.py -k 'test_checkpoint_moe_and_zero'
= 6 passed, 1 deselected, 102 warnings in 156.67s (0:02:36) =

Hi @tjruwase, I almost got this to work, but for some reason when I suppress loading optimizer states for Stage3 tensor correctness fails for model parameters in unit test.
Do you have an idea why?
Is there's something besides optimizer states in Stage3 optimizer states dictionary or is there some side-effect of loading Stage3 optimizer for model parameters?


Honda: HR-V 2023 port

From I got my honda back#0542 on Discord

https://github.com/commaai/openpilot/pull/27731


Max size of image to uplaod

Hi,  I'm trying to upload an Image by the report_image method.
The image is numpy array with shape (4000,3000,3) , and I got this message:
2020-11-25 15:32:20,383 - trains.metrics - WARNING - Failed uploading to https://files..... (Failed uploading object files.trains- ...Example Images_Train Image_00000000.jpeg (413):
<title>413 Request Entity Too Large</title>

413 Request Entity Too Large

nginx/1.17.8

)
2020-11-25 15:32:20,384 - trains.metrics - ERROR - Not uploading 1/1 events because the data upload failed
TRAINS Monitor: Reporting detected, reverting back to iteration based reporting

I want to resize the image dynamically to max size, so I searched for max size of Image in documentation, but could not find it.
What is the max size?

Hi @assafzam,
This is an nginx limitation. The default payload limit for nginx is 1M.
By the way - what are the api_server, web_server and files_server values configured in yout trains.conf file?

Thanks for the answer,
We are Using our own trains server with version 0.16.1-320

That's what I assumed, but I'd like to see the exact URL format of the value in the files_server (and others) in your config file - I think it might help understand why the call is redirected though nginx. Can you share it? You can of course hide or replace the actual IP address or domain name 🙂

🙂
files_server:  https: //files.trains-stage.gerren-eye.ca

Assuming this gets redirected to the Trains File Server (which is Flask based and doesn't pass through nginx in Trains Server's internal setup), I can only assume you have an nginx set up somewhere along the way (load balancer?).
Assuming you locate the nginx that's blocking these requests, you'll need to set up the client_max_body_size setting to allow larger uploads. See https://www.tecmint.com/limit-file-upload-size-in-nginx/ and http://nginx.org/en/docs/http/ngx_http_core_module.html#client_max_body_size .

As trains is behind nginx-ingress, nginx.ingress.kubernetes.io/proxy-body-size: "0" did the job.
"0" disables the limit


interfaces/system: deal with allow dns override globally

Important notices
Our forum is located at https://forum.opnsense.org , please consider joining discussions there in stead of using GitHub for these matters.
Before you ask a new question, we ask you kindly to acknowledge the following:

[x] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
[x] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

DHCP removed handling in 02dc1ebd93 as most of it was inconsequential and IPv6 doesn't care much. Change all that on your way to 22.7.
What's worse is that "dnsallowoverride" cannot be trusted either by pluginctl -g or grep -c for varying reasons of sloppiness that probably created issues with it in the past.

The bulk of this change is going to be shipped in 22.1.5 as c41e28ae552ec.


Rename all AXLOG to AXLOGD (there be 417 without .\core)

See PR: (https://github.com/axmolengine/axmol/pull/2017)
@halx99
Can I do it or any issues for waiting?

Yes, you can, thanks

Before I start: All extensions (I belive yes)?

Yes


Is this abandoned?

Is this abandoned?

Hi, I'm not currently updating it as I'm not working with JS for a while now. If someone would like to take over to further develop it that'd be welcomed


Adding a delegate to get current video playback progress

Thanks @Tibabal please make sure the CI checks pass.


Misplaced urban areas

Describe your issue
I'm trying to use LCZ classification for São Paulo state, Brazil. I was able to run the program successfully, but the resulting file shows a misplaced urban classification. Note that there are urban areas at the coastline in LCZSPInt.tif, but the geo_em.d03_LCZ_params.nc file places them outside (northwest from) the coast. It seems that the geographical projections are off, but it uses EPSG 4236. LCZSPInt.tif was extracted from the LCZ global map produced by Demuzere et al. (2022). If you could help me with any clues on how to solve this, it would be greatly appreciated.

LCZ-SP.zip
w2w --version
w2w.0.4.2
nc-config --all
--cc            -> /usr/bin/cc
  --cflags        -> -I/usr/include -I/usr/include/hdf5/serial
  --libs          -> -L/usr/lib/x86_64-linux-gnu -L/usr/lib/x86_64-linux-gnu/hdf5/serial -lnetcdf
  --static        -> -lhdf5_hl -lhdf5 -lpthread -lsz -lz -ldl -lm -lcurl

  --has-c++       -> no
  --cxx           ->

  --has-c++4      -> no
  --cxx4          ->

  --has-fortran   -> no
  --has-dap       -> yes
  --has-dap2      -> yes
  --has-dap4      -> yes
  --has-nc2       -> yes
  --has-nc4       -> yes
  --has-hdf5      -> yes
  --has-hdf4      -> no
  --has-logging   -> no
  --has-pnetcdf   -> no
  --has-szlib     -> no
  --has-cdf5      -> yes
  --has-parallel4 -> no
  --has-parallel  -> no

  --prefix        -> /usr
  --includedir    -> /usr/include
  --libdir        -> /usr/lib/x86_64-linux-gnu
  --version       -> netCDF 4.7.3

Installed Packages
numpy==1.23.2

Traceback
No response

@flaviandribeiro, could you please also provide the original geo_em files? For sure geo_em.d03.nc, so that we can check what happens ...

Yes, for sure.
geo_em.d03.zip

I'm sending the others too
geo_em.d0.zip

didn't we fix something similar in #60?

That is what I thought as well. I have to check the projection that is embedded in the files of @flaviandribeiro and see whether our implementation of #60 is buggy or not?

So I just ran this example myself. And indeed, the LCZ pixels seems to be shifted north-west-ward.
I do think this must be related to #60, even though in this case MAP_PROJ = 1 (the Lambert projection), which so far never caused issues?
As I am not sure where to start, it might take a bit of time to figure this one out ...

We have also problem with the misplacement of the urban areas, and also may be related to the issue #60. We are working with the rotated latlon projection, and it looks like the w2w tool does not read the projection correctly. In the code the standard equidistant latlon projection is defined (i.e. MAP_PROJ = 6), but the rotated latlon option is not, and therefore I guess the projection is not read correctly, and the LCZ data are not correctly interpolated and therefore misplaced.
I tried to add the projection into the w2w.py code following the link given within the code, but I did not make it work.

The changes I tested in the forked w2w repository that you can find on this link.
We would appreciate any kind of help, as the most of the climate simulations that we are performing are on the rotated latlon projection.

Hi @yoselita: I am sorry to hear you also have issues with the reprojection.
Would it be possible to share your geo_em files, and clipped LCZ map?
@yoselita and @flaviandribeiro: I currently do not have much time to look into this. Not sure if one of you already found a solution to this problem?

Thank you @matthiasdemuzere. Unfortunately, I haven't found yet the solution to the problem. You can download the files I was using to create the map shared above from this link.

Hello!
I haven't found it either, but I haven't got the time to look into it in
detail. I wonder if the information givenin ref_lat, ref_lon, truelat1,
truelat2, and stand_lon in namelist.wps matters to the conversion of
projections.
Thank you!
Em qua., 25 de jan. de 2023 às 07:14, Josipa Milovac <
@.***> escreveu:

Thank you @matthiasdemuzere https://github.com/matthiasdemuzere.
Unfortunately, I haven't found yet the solution to the problem. You can
download the files I was using to create the map shared above from this
link
https://drive.google.com/u/0/uc?id=1JdS_gxTFrH2K0L9vtYdzsUQ5D3cKrYXR&export=download
.
—
Reply to this email directly, view it on GitHub
https://github.com/matthiasdemuzere/w2w/issues/105#issuecomment-1403377412,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AT36VUEGU43MYMGMHS2V5ZLWUD4GRANCNFSM6AAAAAASOTPV6E
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Flávia Noronha Dutra Ribeiro
Environmental Management - School of Arts, Sciences and Humanities
University of São Paulo
Group of Micrometeorology - IAG-USP

Hello!
I think I solved it for my area. The problem was that I haven't been very
careful in determining Truelat1, Truelat2 and Stan_lon in WPS, and w2w uses
the values from the wrf file to pass on to Proj4 to convert the projections.
Thank you very much for the attention and hope that this information helps
other people!
Best regards!
Em qui., 26 de jan. de 2023 às 09:23, Flávia Noronha Dutra Ribeiro <
@.***> escreveu:

Hello!
I haven't found it either, but I haven't got the time to look into it in
detail. I wonder if the information givenin ref_lat, ref_lon, truelat1,
truelat2, and stand_lon in namelist.wps matters to the conversion of
projections.
Thank you!
Em qua., 25 de jan. de 2023 às 07:14, Josipa Milovac <
@.***> escreveu:

Thank you @matthiasdemuzere https://github.com/matthiasdemuzere.
Unfortunately, I haven't found yet the solution to the problem. You can
download the files I was using to create the map shared above from this
link
https://drive.google.com/u/0/uc?id=1JdS_gxTFrH2K0L9vtYdzsUQ5D3cKrYXR&export=download
.
—
Reply to this email directly, view it on GitHub
https://github.com/matthiasdemuzere/w2w/issues/105#issuecomment-1403377412,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AT36VUEGU43MYMGMHS2V5ZLWUD4GRANCNFSM6AAAAAASOTPV6E
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Flávia Noronha Dutra Ribeiro
Environmental Management - School of Arts, Sciences and Humanities
University of São Paulo
Group of Micrometeorology - IAG-USP

--
Flávia Noronha Dutra Ribeiro
Environmental Management - School of Arts, Sciences and Humanities
University of São Paulo
Group of Micrometeorology - IAG-USP


Work with tailwind together

Why not work with tailwind together the end product would be huge. Now we have another CSS Framwork☹.

We'd like to, but unfortunately, they didn't make it easy. https://github.com/windicss/windicss/discussions/176


Fixed Oasis Network Improperly Controlled Modification of Object Prototype Pollution in protobufjs

The package protobufjs is vulnerable to Prototype Pollution, which can allow an attacker to add/modify properties of the Object.prototype. Versions after and including 6.10.0 until 6.10.3 and after and including 6.11.0 until 6.11.3 are vulnerable.
This vulnerability can occur in multiple ways:

by providing untrusted user input to util.setProperty or to ReflectionObject.setParsedOption functions
by parsing/loading .proto files

CVE-2022-25878
CWE-1321
CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:H/A:N

I will close PR for now. Please update and reopen if necessary. The latest oasis sdk is using "protobufjs": "~7.1.2"


SignatureDoesNotMatch: Signature expired

I am runing on a windows with a .NET application.
When the x-ray try to send a data occur this error.
2019-12-17T10:22:42-02:00 [Info] Initializing AWS X-Ray daemon 3.2.0
2019-12-17T10:22:42-02:00 [Info] Using buffer memory limit of 20 MB
2019-12-17T10:22:42-02:00 [Info] 320 segment buffers allocated
2019-12-17T10:22:42-02:00 [Info] STS Endpoint : https://sts.sa-east-1.amazonaws.com
2019-12-17T10:22:42-02:00 [Info] Using region: sa-east-1
2019-12-17T10:23:43-02:00 [Error] Get instance id metadata failed: RequestError: send request failed
caused by: Get http://<IP_ADDRESS>/latest/meta-data/instance-id: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019-12-17T10:23:43-02:00 [Info] HTTP Proxy server using X-Ray Endpoint : https://xray.sa-east-1.amazonaws.com
2019-12-17T10:23:43-02:00 [Info] Starting proxy http server on <IP_ADDRESS>:2000
2019-12-17T10:24:41-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122441Z is now earlier than 20191217T130945Z (20191217T132445Z - 15 min.)
status code: 403, request id: 9761b2b6-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:41-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:24:43-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122443Z is now earlier than 20191217T130947Z (20191217T132447Z - 15 min.)
status code: 403, request id: 98955033-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:43-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:24:44-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122444Z is now earlier than 20191217T130948Z (20191217T132448Z - 15 min.)
status code: 403, request id: 99303125-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:44-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:24:54-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122454Z is now earlier than 20191217T130958Z (20191217T132458Z - 15 min.)
status code: 403, request id: 9f5362fa-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:54-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:24:55-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122455Z is now earlier than 20191217T130959Z (20191217T132459Z - 15 min.)
status code: 403, request id: 9fee43e2-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:55-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:24:56-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122456Z is now earlier than 20191217T131000Z (20191217T132500Z - 15 min.)
status code: 403, request id: a08972d9-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:56-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:24:59-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122459Z is now earlier than 20191217T131003Z (20191217T132503Z - 15 min.)
status code: 403, request id: a25a3b0c-20d0-11ea-aa35-8137046d754e
2019-12-17T10:24:59-02:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-17T10:25:04-02:00 [Error] Sending segment batch failed with: SignatureDoesNotMatch: Signature expired: 20191217T122504Z is now earlier than 20191217T131008Z (20191217T132508Z - 15 min.)
status code: 403, request id: a5611201-20d0-11ea-aa35-8137046d754e
2019-12-17T10:25:04-02:00 [Warn] Delaying sending of additional batches by 0 seconds

Hi flastowizka,
Looks like the underlying AWS SDK the Daemon uses is encountering a problem signing the request. It looks like a clock skew issue as per: https://stackoverflow.com/questions/22459155/ses-aws-error-code-signaturedoesnotmatch-status-code-403
Here's some steps to try to re-sync your Windows machine: https://answers.microsoft.com/en-us/windows/forum/windows_10-other_settings/how-to-force-windows-10-time-to-synch-with-a-time/20f3b546-af38-42fb-a2d0-d4df13cc8f43'
Let us know if this works.
Thanks!
Sandra

@awssandra thanks, its helps to solve the problem.
But now not works yet, occurred another error related with IAM. I just searching the solution.
[Error] Sending segment batch failed with: AccessDenied: User: arn:aws:iam::06469999999:user/ec2-xray is not authorized to perform: sts:AssumeRole on resource: arn:aws:iam::06499999996:role/xray-application

That's a permissions issue with your IAM user. It can't assume the x-ray role for publish permissions.
See: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use_permissions-to-switch.html
Check if ec2-xray has the following:
"Statement": {
"Effect": "Allow",
"Action": "sts:AssumeRole",
"Resource": "arn:aws:iam::xxx:role/xray-application"
}
I assume here "xray-application" IAM role has the appropriate X-Ray permissions (under XRayDaemonWriteAccess) as listed here: https://docs.aws.amazon.com/xray/latest/devguide/xray-permissions.html

The same result with this permission.
IAM User

IAM Role

2019-12-20T00:27:54-03:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-20T00:29:23-03:00 [Info] Initializing AWS X-Ray daemon 3.2.0
2019-12-20T00:29:23-03:00 [Info] Using buffer memory limit of 20 MB
2019-12-20T00:29:23-03:00 [Info] 320 segment buffers allocated
2019-12-20T00:29:23-03:00 [Info] STS Endpoint : https://sts.sa-east-1.amazonaws.com
2019-12-20T00:29:23-03:00 [Info] Using region: sa-east-1
2019-12-20T00:30:25-03:00 [Error] Get instance id metadata failed: RequestError: send request failed
caused by: Get http://<IP_ADDRESS>/latest/meta-data/instance-id: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019-12-20T00:30:25-03:00 [Info] HTTP Proxy server using X-Ray Endpoint : https://xray.sa-east-1.amazonaws.com
2019-12-20T00:30:25-03:00 [Info] Starting proxy http server on <IP_ADDRESS>:2000
2019-12-20T00:31:03-03:00 [Error] Sending segment batch failed with: AccessDenied: User: arn:aws:iam::999999999999999999:user/ec2-xray is not authorized to perform: sts:AssumeRole on resource: arn:aws:iam::99999999999999999:role/xray-application
status code: 403, request id: 25c3fc57-22d9-11ea-b13d-e10c61034c14
2019-12-20T00:31:03-03:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-20T00:31:05-03:00 [Error] Sending segment batch failed with: AccessDenied: User: arn:aws:iam::999999999999999999:user/ec2-xray is not authorized to perform: sts:AssumeRole on resource: arn:aws:iam::99999999999999999:role/xray-application
status code: 403, request id: 26f5505f-22d9-11ea-b13d-e10c61034c14
2019-12-20T00:31:05-03:00 [Warn] Delaying sending of additional batches by 0 seconds
2019-12-20T00:31:11-03:00 [Error] Sending segment batch failed with: AccessDenied: User: arn:aws:iam::999999999999999999:user/ec2-xray is not authorized to perform: sts:AssumeRole on resource: arn:aws:iam::99999999999999999:role/xray-application
status code: 403, request id: 2aa58685-22d9-11ea-b13d-e10c61034c14
### cfg.yaml
`# Maximum buffer size in MB (minimum 3). Choose 0 to use 1% of host memory.
TotalBufferSizeMB: 0
Maximum number of concurrent calls to AWS X-Ray to upload segment documents.
Concurrency: 8
Send segments to AWS X-Ray service in a specific region
Region: "sa-east-1"
Change the X-Ray service endpoint to which the daemon sends segment documents.
Endpoint: ""
Socket:
Change the address and port on which the daemon listens for UDP packets containing segment documents.
UDPAddress: "<IP_ADDRESS>:2000"
Change the address and port on which the daemon listens for HTTP requests to proxy to AWS X-Ray.
TCPAddress: "<IP_ADDRESS>:2000"
Logging:
LogRotation: true
Change the log level, from most verbose to least: dev, debug, info, warn, error, prod (default).
LogLevel: "prod"
Output logs to the specified file path.
LogPath: ""
Turn on local mode to skip EC2 instance metadata check.
LocalMode: false
Amazon Resource Name (ARN) of the AWS resource running the daemon.
ResourceARN: ""
Assume an IAM role to upload segments to a different account.
RoleARN: "arn:aws:iam::999999999:role/xray-application"
Disable TLS certificate verification.
NoVerifySSL: false
Upload segments to AWS X-Ray through a proxy.
ProxyAddress: ""
Daemon configuration file format version.
Version: 2
`

solved the problem.
In the documentation they are say to add IAM Role trust with the ec2.
I just change it to trust role with the user to assume role, then works.


Add clang-format-ignore file support

This PR adds an option to exclude files based on patterns defined in a .clang-format-ignore file.
It works the same as passing multiple --exclude file arguments.
Fixes #12

Thank you for this PR, that would fix #12 I think.
Would you mind removing the option that make this path configurable?
I feel like we should use a single convention, and maybe, if there is some other files already in the wild, we could support them explicitly instead.
Not sure if it matters for fnmatch, but the file will read as bytes in Python 2, and unicode in Python 3.
Usually I use io.open(..., encoding='utf-8') for this reason.

Thank you for the review. I applied the changes, also fixed the description to close the issue.

Merged, thank you very much for the contribution, and your patience!


[BUG] ffplay playback

Describe the bug
Im trying to make a simple spotify player but when ever i use the example ffplay example i get this error
Traceback (most recent call last):   File "/home/toby/SpotifyPlayer/main.py", line 61, in <module>     ffplay.stdin.write(byte) BrokenPipeError: [Errno 32] Broken pipe
To Reproduce
Use
while True:     byte = stream.input_stream.stream().read(1)     if byte == -1:         break     ffplay.stdin.write(byte)
Expected behavior
It should play the song via ffplay
Client Information (please complete the following information):

OS: [Ubuntu 20.04]
Python Version [3.8.10]
Library Version [0.7.1]

Additional context
Add any other context about the problem here.

I have found out this is because its using SDL to show and play the music


Connecting refinement with another indice

Hi!
I have been searching about this but I havent gotten very far. Basically I am trying to connect my hierarchicalMenu with another indice. Like this:
Right now I have 2 indices. One containing songs, and another one containing taxonomies for the songs (genres).
The song indice also have an attribute called genre, which can connect it to the genre indice.
The genre indices include information about the genre, for example a description of "Rock" and an icon.
I am displaying results from the song indices to the users, with genre as a hierarchicalMenu. However, since this is just a refinement of the "Genre"-attribute, this list is not connected to the Genre indices at all.
So for example, if I wanna display the icon for each genre next to the refinement list, what would be the strategy for this? They both have a matching key which can use to connect the attribute to the entry in the genre indices.
Does anybody know of an example where anything similar is done? Or what is the correct way to approach this.

Could you make the experience you have now in a sandbox? It will be easier to know what exactly you’re expecting.
We have a template available for that purpose here. Thanks!

Well the experience I have right now is pretty similar to the sandbox you sent.
In the example you sent there are brands. Right now they are a taxonomy of each product.
So in your example, if you would like to display the logo next to each brand in the refinementlist, how would this be done?
I have indexed another indices containing all the brands. This contains logo, description, etc about each brand. I want to display this information in the refinementlist for my main indices (instant_search in your example).
I've dont know where to start on this functionality so I dont have any code to show you for it, all i've done is index all brands separately.

It seems that you followed the principle of denormalization in your index. Algolia, and other search engines, usually use the denormalization strategy because they support other constraints than most databases (including high performance).
We didn't yet consider the feature you're suggesting because we'd need to make a lot of assumptions:

Is the index name a valid-enough heuristic to "merge" the facets results?
Should we target n indices every time a query is performed?
How does this fit in the Federated Search paradigm?

Another solution that I would have seen and would have expected to work if I was a first-time Algolia user would be to access the images as part of the facet value schema. To my knowledge, there's no easy way to retrieve the images associated with the facet value even if you were to store the image with the refined value in the index ({ "value": "Samsung", "image": "samsung.svg" }). This happens because Algolia only returns the faceted value ("Samsung"), and not the whole object.
The easiest solution for now would be to facet the strings and to use some pattern matching in the frontend.

As there was no response, I assume the original issue is fixed now. If you still have problems, please open a new issue with reproduction :)