Multiclass classification doesn't improve with custom objective

Description
I wanted to implement a custom objective for a multiclass classification task. According to the documentation, a custom objective for a multiclass classification task receives y_pred in the shape of [n_samples, n_classes]. Though when I debug the code, y_pred is of shape [n_samples * n_classes], which is why I reshape it in the custom objective function. Since the inputs are flat, I had to flatten the outputs grad and hess as well (otherwise "TypeError: Wrong type(ndarray) for gradient. It should be list, numpy 1-D array or pandas Series" was raised). The model performance doesn't improve with training, the output looking like this:
[1]     training's multi_error: 1       training's multi_logloss: 34.5388
[2]     training's multi_error: 1       training's multi_logloss: 34.5388
[3]     training's multi_error: 1       training's multi_logloss: 34.5388
[4]     training's multi_error: 1       training's multi_logloss: 34.5388
[5]     training's multi_error: 1       training's multi_logloss: 34.5388
[6]     training's multi_error: 1       training's multi_logloss: 34.5388
[7]     training's multi_error: 1       training's multi_logloss: 34.5388
[8]     training's multi_error: 1       training's multi_logloss: 34.5388
[9]     training's multi_error: 1       training's multi_logloss: 34.5388
[10]    training's multi_error: 1       training's multi_logloss: 34.5388
Reproducible example
import numpy as np
import torch
from sklearn.datasets import load_iris
from sklearn.model_selection import train_test_split
import lightgbm as lgb

def cross_entropy_obj(y_true, y_pred):
    n_classes = len(np.unique(y_true))
    y_pred = y_pred.reshape((y_true.size, -1), order='F')
    n_samples = y_pred.shape[0]
    y_true = np.identity(n_classes)[y_true.astype(int)]
    y_pred = np.clip(y_pred, a_min=1e-7, a_max=1.0)

    grad = (y_pred - y_true)
    hess = y_pred * (1 - y_pred)
    return grad.flatten(order="F"), hess.flatten(order="F")

X, y = load_iris(return_X_y=True)
X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=42)

model = lgb.LGBMClassifier(objective=cross_entropy_obj,
                       n_estimators=10, random_state=42)
model.fit(X_train, y_train, eval_metric="multi_error",
          eval_set=(X_train, y_train), verbose=True)

Environment info
LightGBM version or commit hash: Version: 3.3.5
Command(s) you used to install LightGBM
pip install lightgbm

Hi @anitaschaefer, thanks for using LightGBM. The change to use 2D collections hasn't been included in a release yet, the documentation you're looking at refers to the master branch, not the last released version.
You can find an example on how to implement multilogloss as a custom objective with the 1D collections below
https://github.com/microsoft/LightGBM/blob/caa087bcc5de5023097de84646976013fc3e353d/tests/python_package_test/test_dask.py#L274-L290
Please let us know if you have further doubts.

@jmoralez your loss function works in my code, thanks!


pull request for e2e test at 11/20/2016 20:26:07

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

optest/docs/updated_at.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add 'jcs' and 'urdna2015' canonicalization values.

Adds a new canonhash tag value that represents a combination canonicalization+hash operation (using RDF Dataset Canonicalization URDNA2015, soon to be renamed to URDCA2015).
Used for the hashlinking of Verifiable Credentials proposal to the W3C VC WG, in the implementation of digestMultibase.
digestMultibase example:
MULTIBASE('base58btc', CANONICALIZE('urdca-2015-canon', MULTIHASH('sha256', <canonicalized input>)))

MULTIBASE('base58btc', CANONICALIZE('jcs-canon', MULTIHASH('sha256', <canonicalized input>)))

Do I understand it correctly MULTIHASH('jcs', MULTIHASH('sha256', <canonicalized hashed VC>)) would still be a SHA-256 hash? Is the idea that you'd like to be able to determine "that SHA-256 came from a canonicalized JSON according to the JCS rules"?

That's it, exactly. Tagging jcs as a multihash is not exactly right, but we're trying to work with the limitations of the fact that MULTIHASH has essentially one parameter, but really needs multiple params (see the discussion for issue 78/Parametrized Hashing https://github.com/multiformats/multihash/issues/78, and issue 56 https://github.com/multiformats/multihash/issues/56)

Ok, on further conversation, it might be less confusing to people if this PR introduced a new tag (instead of overloading the use of multihash).
So instead, I propose adding a canonized hash tag.

In your original comment you mention hashlinking. Is the goal to use that multicodec code as part of a CID?
I'm asking as I think this request poses an interesting question. If I think in terms of a CID, where we specify the encoding as well as the hash algorithm, the question is, should this be the encoding information or the hash algorithm information?
To me a CID is self-describing on how to get from the bytes it points to, to some deserialized version of it and back. If the hash algorithm is always SHA-256, I can see two ways describing it:

The encoding is JSON and the hash algorithm is "canonicalize things first, then do a SHA-256" hash.
The encoding is canonicalized JSON and the hash algorithm is SHA-256.

In both cases you'd have all the information you need.

@dlongley This means that urdca2015 and jcs aren't about hashing at all, they are about the step before the hashing. I still guess you want to use this as part of a CID, so the only possible place to put this identifier in is the data codec (the CID spec names that "multicodec codec type"). The information there is used to know how to encode/decode the bytes that were addressed with the CID. Is JCS always JSON and URDCA2015 always XML? Or could also other data formats be canonicalized with such algorithms?

@vmx

@dlongley This means that urdca2015 and jcs aren't about hashing at all, they are about the step before the hashing.

Right, exactly. They're essentially a second parameter to the multihash (what pre-processing steps must be taken with the data before hashing).

Is JCS always JSON and URDCA2015 always XML? Or could also other data formats be canonicalized with such algorithms?

JCS is always JSON. URDCA2015 is any sort of RDF-based linked data (which includes JSON, Turtle, RDF-XML, N-Quads, etc).

To me a CID is self-describing on how to get from the bytes it points to, to some deserialized version of it and back. If the hash algorithm is always SHA-256, I can see two ways describing it:

The encoding is JSON and the hash algorithm is "canonicalize things first, then do a SHA-256" hash.
The encoding is canonicalized JSON and the hash algorithm is SHA-256.

Right, so, this is thee tricky part. I'd say the situation is closer to 1 -- the hash algorithm is "canonicalize things first, then do a SHA-256" hash. And the encoding (of the hash) is multibase. (I'm not sure it's necessary to specify the encoding of the pre-hash data, though. Since the hash is a one-way operation.)
@vmx - would you be open to defining a new "canonized hash" tag?

Finally found time to look at this and give my 2c.

Firstly, I'd like to make a bit of space after the poseidon* entries because we can expect more of those, maybe bump it to 0xb503 or even find a different space for it around that area.
I don't think I have an objection to making a new tag for this, it really is a different beast, and it's not like we have strong rules for that column anyway. It would probably be inappropriate to make it multihash or ipld or even serialization since it's not quite any of those.
I think I could see a path to this being used in CIDs if you implement it as a faux-multihash. Our implementations have ways of abstracting the multihash part of a CID such that you just need to be able to produce a digest. So, you could implement this as a layer ontop of the existing mutlihash interfaces so you take existing multihash implementations and wrap them in this thing and the multihash part of the CID is really a multihash(multihash), although as far as the CID implementations are concerned it's just the one multihash. That would be interesting to see work and there may be hiccups along the way. I'm not sure it's a great idea, but it doesn't seem impossible.
Having said all of that ^, using this for CIDs does feel a bit like a hack, to squish information into a CID because CIDv1 doesn't have the ability to convey quite enough information as it is. Maybe this goes into the wishlist bucket for CIDv2?

I'd like to check if I understood the current outcome correctly.
The urdca-2015-hash is used in the multihash part of the CID. So a CID would look like this (I leave out the size information bits for simplicity):
<v1><can-e.g.-be-json-turtle-xml><urdca-2015-hash><the-hash-digest>

This points to some data.
Now I retrieve the data and I want to create a CID out of it. I would only know that I need to canonicalize the the data before hashing, but I wouldn't know which hash algorithm to use. Is that correct?

@dmitrizagidulin any changes to this you want to pursue so we can get this over the line in some form?

Hi @rvagg, thanks for checking in.
So, yeah, absolutely, we’ve got even more implementations in need of this mechanism on the way, so we definitely want to find some kind of solution. (I was chatting with @gobengo about this just yesterday, and he gave me a couple new vectors to consider.) So, let me review the issue and get back to you later today.

Hi @rvagg -- after some discussion with @gobengo, I've updated the PR (and resolved merge conflicts) to hopefully address some of your concerns.

Firstly, I'd like to make a bit of space after the poseidon* entries because we can expect more of those, maybe bump it to 0xb503 or even find a different space for it around that area.

Totally understood wanting to make space -- I moved the JCS canonicalization entry to post-poseidon.
If at all possible, we would really like to keep urdna-2015-canon entry as 0xb403. (This is totally my fault, I dropped the ball on resolving this PR, and meanwhile the 0xb403 tag is being deployed to millions of Point-of-Sale systems (literally old-school cash registers) as part of a US-wide Age Verification project.)
We've also updated the tag for those two entries to re-use ipld (on Bengo's advice), instead of introducing a new 'canonhash' tag. This is because jcs-canon is essentially a standardized version of what json-dag does (sorts/canonicalizes JSON input so that it can be composed with hashing).

@dmitrizagidulin,

We've also updated the tag for those two entries to re-use ipld (on Bengo's advice), instead of introducing a new 'canonhash' tag.

Does that mean the existing implementations need to change? If not, why not?

Hey @dlongley - no, no existing implementations need to change. The tag in the CSV file is conceptual / for organizing things into categories, it's not used in the code.

Thanks for the merge @rvagg.
To come back to ipld not being the right way to go, I agree. Can we just use "multiformat" for the tag name?
If not, what if we introduced a new "transformed-multihash" namespace? It's not clear to me what constitutes a "namespace" vs. a "multiformat".

@msporny the tags really don't matter that much so it's not worth getting too hung up about it - I imagine a future point where we refactor a bunch of the organisational stuff and they become more relevant at which point we take a more holistic view of what we have and do some adjustment.
If something feels like it should be just "multiformat" then we should probably just invent a new tag for it - if you're making something that could be described in a new multiformat spec then make a tag as a new category. I'm not sure about "namespace", mostly I treat those as networking / libp2p related so usually not appropriate for hashing or encoding.
I'd be happy for someone to come up with a new tag for this, but maybe something broad enough that can fit other things too? transformed-multihash might work, it's a little long but it explains the purpose. multimultihash might be a bit too cute, compound-multihash is another option in the same theme.

Can't believe I'm just seeing this now! Really glad that this has been put in place.
IMO IPLD is absolutely something that we should look into here since we can use this as a component of IPLD based database systems at large.

https://github.com/gobengo/iprd


AWS Format Roles Bug Fix for Homebrew

I believe the initial bug has been addressed in #459, but was just wondering if there was going to be another release to fix the issue on homebrew. Unless there's a way to compile a formula locally and run the working version on master.
Expected Behavior

Bug fix for #459 is implemented when running brew install gimme-aws-creds
Current Behavior

Running brew install gimme-aws-creds still has the profile formatting error`
Possible Solution

Update release version
Steps to Reproduce (for bugs)

Context

A lot of automation scripts are failing and it seems the only workaround is install a python version and switching virtualenvs before running gimme-aws-creds
Your Environment

App Version used: <IP_ADDRESS>
Environment name and version: N/A
Operating System and version: MacOS Sonoma 14.2.1, Apple Silicon

Have the same on the pip installation

Ah, I see it is fixed in master, but is not yet released

2.8.2 has been released


a tiny error

in fuzz.impl 278 row
template <typename Sentence1, typename Sentence2, typename CharT1, typename CharT2>
should be template <typename Sentence1, typename Sentence2>

I do not see why this would be an error. However I agree that they should be removed, since they are not used anymore.


feat(tools): make context more generic

Checklist:

[x] I have read and followed the contribution guidelines.
[x] I have read and followed the how to open a pull request guide.
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

To pass the context bsSize to panel's headers, I needed to create a hook similar to formContext, but to save time and to not waste effort, I have DRY it, so it can be used in different places, with different types of context.
Although I think this is ready for review, I think it's better to wait for https://github.com/freeCodeCamp/freeCodeCamp/pull/46758 to merge, because I may be misunderstanding context and this may be breaking the formGroup, and formGroup has the test that test for context anyway. 🤷

I was planning to create a function that pass argument and create context through it, but that was to abstract and to be honest, I am still burnt out from the editor affecting multiple area that I don't want to create similar thing


Audio delay fix & more

So I've got some issues like my mic getting glitchy globally, mic sound getting delayed and even app crashing (related to the first issue).
The first 2 commits should hopefully fix those problems.
Glitching mic issue was because it was reinitialized a lot and godot doesn't dispose old instances of it, the app was crashing for the same reason, and audio delay is probably because of the bus auto-disabling feature so I simply disabled it.
The 3rd commit is just there in case people like it.
Test it to make sure the issues got resolved.

guh

guh

What the
On Wed, Jul 3, 2024, 12:42 Ralty @.***> wrote:

@.**** approved this pull request.
—
Reply to this email directly, view it on GitHub
https://github.com/kaiakairos/PNGTuber-Plus/pull/8#pullrequestreview-2155424029,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BJTEYGRHT5DWDE6PP6CCKNDZKN6K3AVCNFSM6AAAAABKINELEOVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDCNJVGQZDIMBSHE
.
You are receiving this because you commented.Message ID:
@.***>


Introduce the Store + fixes to validation

Closes #486
Introduces the Store abstraction and adopts it in the test cases, cleaning up a lot of unnecessary test cases. I am opening the PR in draft, as it needs rebasing anyway.
The change is relatively simple, it introduces the Store as described in #486, with a fluent interface of the type:
var store = new Store()
   .addFunctions(f1, ...)
   .addGlobals(g1, ...)

This API is copied over from HostImports, although this is not a subclass; it is still "related" to it; in fact:

it is possible to get the contents of a store ("converting" it, if you will) to a HostImports instance with store.toHostImports();
the Store also accepts an entire HostImports instance as a shorthand for registering all of the items in it with store.addHostImports(hostImports)

It also provides shorthands to register all of the exports in a module as qualified "HostGlobal"s, "HostFunction"s etc.
store.register("name", instance); // now each export `e` in instance, is stored as the qualified name `name.e`

It is also possible to instantiate and register in one move:
var instance = store.instantiate("name", module);

this is equivalent to:
var instance = Instance.builder(module).withHostImports(store.toHostImports()).build()
store.register("name", instance)

The Store is deterministic, in that its behavior is known: when clashing instances (i.e. where their qualified name n.e is clashing) are registered to the store, the latest registration overwrites the oldest. Internally each type(*) (globals, funcs, etc) is kept in separate LinkedHashMaps.
Introducing the Store enormously simplifies the definition of the spec tests, because such tests actually expect changes to "stick" across cases; i.e. they mutate sequentially a shared store instance adding and updating memories, functions, globals, tables.
In fact, introducing the store highlighted a bunch of issues with validation, that I am fixing contextually: even though we would not let any invalid instance slip, we would raise UnlinkableExceptions during the initialization of the instance, instead of throwing an InvalidException at validation time.
Potentially this allows us to avoid the second check at the time of instantiation, because we could assume that validation has passed.
(*) note: this actually means that clashes might exists if two different types have the same qualified name 🤔
e.g. n.e is a func, but there is also a n.e that is a global 🤔

+1 @electrum :)


Display expiration data for invitation links

We should add a column "Expiration date" in the "organization settings" invitation links UI.  And then extend the UI to allow specifying/editing the expiration time for invitations (rather than the 10 day default).
This is really important for organizations that want to use specific invitation links with members of different types to set default streams properly.

@zulipbot claim

@timabbott I think making a calendar for specifying expiration time for invitations would be better suited or should we implement a
plus minus counter. What do you think?

Still working.

@zulipbot claim

@zulipbot still working

@zulipbot  claim

@zulipbot unclaim
There's a pr under review for this.


python310Packages.mkdocs-minify: 0.6.3 -> 0.7.1

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python310Packages.mkdocs-minify is: A mkdocs plugin to minify the HTML of a page before it is written to disk.
meta.homepage for python310Packages.mkdocs-minify is: https://github.com/byrnereese/mkdocs-minify-plugin
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.7.1 with grep in /nix/store/lrz3kasmdzccsxpd0lyf1r4b7ybmmkdg-python3.10-mkdocs-minify-0.7.1
found 0.7.1 in filename of file in /nix/store/lrz3kasmdzccsxpd0lyf1r4b7ybmmkdg-python3.10-mkdocs-minify-0.7.1

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)

3 package rebuild(s)

First fifty rebuilds by attrpath
ntfy-sh
python310Packages.mkdocs-minify
python311Packages.mkdocs-minify

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/lrz3kasmdzccsxpd0lyf1r4b7ybmmkdg-python3.10-mkdocs-minify-0.7.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python310Packages.mkdocs-minify https://github.com/r-ryantm/nixpkgs/archive/dbdd3d434f13423b3afa2ac5a40eedb5bb3d793e.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/lrz3kasmdzccsxpd0lyf1r4b7ybmmkdg-python3.10-mkdocs-minify-0.7.1
ls -la /nix/store/lrz3kasmdzccsxpd0lyf1r4b7ybmmkdg-python3.10-mkdocs-minify-0.7.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

3 packages built:

ntfy-sh
python310Packages.mkdocs-minify
python311Packages.mkdocs-minify

Maintainer pings
cc @tfc for testing.

getting some failures on
> FAILED tests/test_basic.py::test_build_no_extras - AssertionError: assert '468e45e1d823...6a9935800c135' == '544b92316ee6...08...
       > FAILED tests/test_basic.py::test_build_with_extras - AssertionError: assert 'b164f41214bc...f4b0badb92ec1' == 'c102275d47fb...f6...
       > FAILED tests/test_basic.py::test_build_cache_safe - AssertionError: assert '6ae88614660e...a9be2bcc6e322' == '315459f1b231...bf...
       > FAILED tests/test_basic.py::test_build_cache_safe_minified - AssertionError: assert '24ebe2595698...8bd4f6d8c5f85' == '4e4abcfcf21f...34...

on linux-x86_64
@tfc should we just disable those ?

You mean you get these errors when rebuilding this package?

This could be the result of the recent staging-next upgrade potentially.

The requirements specify htmlmin2 and we are passing htmlmin.
even when disabling those tests, the package build still fails.

The requirements specify htmlmin2 and we are passing htmlmin.
even when disabling those tests, the package build still fails.
I tried packaging htmlmin2, the fork of htmlmin, but I still get those tests failures and the build fail on darwin.
I'm curious if you have a better way to resolve this.

for reference, I came this because I'm using ntfy-sh which depends on this.


neon: 0.29.6 -> 0.30.1

Test build.
It is my update of a library package, so I'm not sure how to test this properly (as it can not be test started, obviousely).

Built locally thanks.

This update broke davfs2: http://hydra.cryp.to/build/1319898/log/raw.

I will re-add the old version of neo and fix this, if not fixed already.
Will propably take 30-60 mins until I can do this.

PR coming...


Wake lock not working on Android, adapt NoSleep.js video setup

The wake lock in webvr-polyfill was not working properly on my Moto Z Play with Chrome 56.
Attaching the debugger, I got this error which makes it sound like Chrome is having issues with the video:
«Uncaught (in promise) DOMException: Failed to load because no supported source was found.»
I then tried NoSleep.js and that was working fine. This pull request uses the video setup from NoSleep.js (adding source HTML elements, MP4+WebM videos, looping instead of ended event), with which the wake lock in webvr-polyfill is working for me again.
(I did try just using the MP4 video from NoSleep.js but that gave the same error. Not sure what the issue is but the wake lock only works for me with the WebM version).

I signed it!

Thanks for the fix, and apologies for how long it's taken to merge. We're working through a maintainers re-org.


[Dialog] repositionOnUpdate works wrong

Problem description
Dialog's repositionOnUpdate works wrong when height changes in one step (e.g. from 600px to 900px).
Link to minimal working code that reproduces the issue
You can see the problem in documentation (http://www.material-ui.com/#/components/dialog). Use developer tools to see problem (you need to doc it to the bottom of the screen).

Open scrollable dialog (example number 5)
Open / close developer tools
You will see that dialog's bottom part is not available now (see video: http://take.ms/Yre18)

Versions

Material-UI: latest
React: any
Browser: any (tested in chrome, firefox and safari)

Right, there is a variety of issue with the Dialog, it's most likely a duplicate of #2322.


reflect

Context: https://tour.golang.org/moretypes/6
Change the title above to describe your issue and add your feedback here, including code if necessary

Can you be more specific? What is the issue?

Looks like a "report" button misfire. Closing here. Comment if you actually have a bug to report.


Add option for elevated headers

Adding a way to set elevation on headers could be useful.

Implemented in #14


Vim9: conditional return statement causes E1028 error

Describe the bug
Vim9 script fails to compile a function which has conditional statement.
To Reproduce
Loading the following script causes E1028: Compiling :def function failed error but I can't tell what's the actual problem.
vim9script
def F()
  if 1 < 0
    return
  endif
enddef
echo F()

Expected behavior
I believe this is a valid Vim9 script and echos 0 with no error.
Screenshots
If applicable, copy/paste the text or add screenshots to help explain your problem.
Environment (please complete the following information):

Vim version 8.2.2000
OS: macOS 10.15.7
Terminal: iTerm2

Additional context
Add any other context about the problem here.

I noticed another case which causes SEGV. I believe this script is also valid.
vim9script
def F(): number
  if 1 < 0
    return 0
  endif
  return 1
enddef
echo F()

I noticed another case which causes SEGV with 8.2.2000.

backtrace
valgrind log
asan log

Describe the bug
Vim9 script fails to compile a function which has conditional statement.
To Reproduce
Loading the following script causes E1028: Compiling :def function failed error but I can't tell what's the actual problem.
vim9script
def F()
  if 1 < 0
    return
  endif
enddef
echo F()

Expected behavior
I believe this is a valid Vim9 script and echos 0 with no error.

Interesingly, it works if the "1" is replaced by a global:
vim9script
g:one = 1
def Test()
  if g:one < 0
    return
  endif
enddef

Thus it's related to evaluating the condition at compile time.
--
There is a fine line between courage and foolishness.
Unfortunately, it's not a fence.
/// Bram Moolenaar --<EMAIL_ADDRESS>-- http://www.Moolenaar.net   \
///        sponsor Vim, vote for features -- http://www.Vim.org/sponsor/ \
\\  an exciting new programming language -- http://www.Zimbu.org        ///
\\            help me help AIDS victims -- http://ICCF-Holland.org    ///


Add :uniq kwarg to #delete_rpath and #change_rpath

Continuation of #362.

Also, JFYI: I'll cut these changes along with everything else in a 3.0 release (since our supported Rubies have changed, and I believe SemVer considers that a breaking API change).

Great, sounds good to me. I've got a draft for #uniq_rpaths! locally, but I still need to add some tests, and possibly add it to MachO::Tools as well.


Switch to composite action

long overdue updates:

[x] switch to composite action
[x] migrate python packaging info to pyproject.toml
[x] ran a few dev tools:

spell-checker
black (py formatter)
ruff (py linter)

[x] use pre-commit for future updates' format checking

Welcome to Codecov :tada:
Once merged to your default branch, Codecov will compare your coverage reports and display the results in this comment.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


Fix preload issues

When using preload scripts in the latest version of Electron, this error occurs. After testing this should fix it.

nevermind this isnt the issue


Why / Balance

This line would likely be against the rules if a player said it. On CD we
already got multiple ahelps about this line.
Technical details

YAML
Requirements

[X] I have read and I am following the Pull Request Guidelines. I understand that not doing so may get my pr closed at maintainer’s discretion
[X] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes

Changelog

No changelog needed

On CD we
already got multiple ahelps about this line.

what exactly they complain about?

Somebody started using a bunch of the figures next to an intercom and when this line was played it was met with "what the fuck" in OOC chat along with an ahelp from somebody who assumed it was a player that said it. Depending on the context, a line like this could easily get somebody banned on CD and I suspect wizden as well.

Speedmerging on tests finish because the removed line is indeed against server rule 1.4, which is a zero-tolerance rule.


IPrompt: Render prompts in a wrapper

I would like to create a TUI based app with a layout similar to Midnight Commander (menu at the top and bottom and a prompt between them). Menus are simple text with commands (e.g., Exit [ESC], etc.). The prompts are async to be able to interrupt them when a menu command key is pressed.
Solutions:
a) Insert the prompt into a table
b) Set TopWrapper and BottomWrapper: wrappers will be rendered in their respective positions
I'm sure if it were easy to implement, it would have been done alread

Prompts do not implement IRenderable, and are not designed to be used inside tables or similar as stated in our docs. This is by design.


VOIP calling not working on iOS 13.

@manuroe  Can you please update on issue. I am also facing the same. Is it fixed or any other workaround?
https://github.com/vector-im/riot-ios/issues/3216
"Killing app because it never posted an incoming call to the system after receiving a PushKit VoIP push callback"

This is normal and currently expected :/
Please use Xcode 10.3 while all the work in https://github.com/vector-im/riot-ios/milestone/32 is not completed.

Hi @manuroe , I'm also getting same issue in xcode 11.2.1 and the iOS 13.3.1 . above you suggested to use Xcode 10.3.
If we use Xcode 10.3, the build is not compatible with iOS 13x devices right. is there any solution to run build in iOS 13x devices.


SpotApi.Account.WithdrawAsync should specify 'amount' rather than 'quantity'

Instead of 'amount', the request sends 'quantity'. This correct key name can be seen in the docs: https://bitgetlimited.github.io/apidoc/en/spot/#withdraw-v2.
This is an example of the request that is (wrongly) sent:
{
"address": "address",
"chain": "XRP",
"coin": "XRP",
"quantity": "22.5",
"tag": "34242343"
}

I've opened a pull request to fix this issue: https://github.com/JKorf/Bitget.Net/pull/14


Legacy System Migration - Saperion

Hi,
First and foremost I want to say thank you for developing such an amazing tool
Under the Legacy System Migration page i can see that Saperion is included in your list. Can i ask what needs to be done on the Saperion side in order for me to perform the migration?
I am going through some pdf documentation regarding Saperion and honestly i need all the help i can get! D:
Any tips / help will be very appreciated
Thanks for your time

Hi tommy,
I'm happy to give you a few pointers for saperion....
Firstly - which database are you using MS SQL Server?  DB2?
Assuming SQL server can you run the following query and send results?
SELECT
QUOTENAME(SCHEMA_NAME(sOBJ.schema_id)) + '.' + QUOTENAME(sOBJ.name) AS [TableName]
, SUM(sPTN.Rows) AS [RowCount]
FROM
sys.objects AS sOBJ
INNER JOIN sys.partitions AS sPTN
ON sOBJ.object_id = sPTN.object_id
WHERE
sOBJ.type = 'U'
AND sOBJ.is_ms_shipped = 0x0
AND index_id < 2 -- 0:Heap, 1:Clustered
/and QUOTENAME(sOBJ.name) like '%report%'/
GROUP BY
sOBJ.schema_id
, sOBJ.name
ORDER BY [RowCount] desc
GO
You can email me direct with the output.
RSEDRMS @ gmail.com
Best
Robert

Thanks for your prompt reply Robert. You are right it is / should be SQL
I'll will try and get the results if possible

Hi Robert
I am in weird situation where our Saperion support person is not too SQL savvy after i sent him an email regarding the SQL query above. Can i ask what data the SQL query fetches?
Also, the Saperion support guy said that he can export the metadata from the SQL tables as well as a list of the tables that is currently in use
How should i proceed in regards to migrating Saperion to Sharepoint?
Thanks

Tommy,
You will need to get yourself direct access to the SQL database or at least
a copy of it so that you can run such queries yourself.
Best
Robert Smith
<EMAIL_ADDRESS>On Tue, Oct 23, 2018 at 9:48 PM tommy1520<EMAIL_ADDRESS>wrote:

Hi Robert
I am in weird situation where our Saperion support person is not too SQL
savvy after i sent him an email regarding the SQL query above. Can i ask
what data the SQL query fetches?
Also, the Saperion support guy said that he can export the metadata from
the SQL tables as well as a list of the tables that is currently in use
How should i proceed in regards to migrating Saperion to Sharepoint?
Thanks
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/MadAboutImport/DIFS/issues/14#issuecomment-432413689,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AqJUD5lrjfpbkq4uOvX13eDfjCrkU9Nvks5un4COgaJpZM4XdeOV
.

Tommy,
Thanks.  What SharePoint are you using?  SharePoint Online or SharePoint
OnPremises?  Also as a general rule since a lot of this it nothing to do
with the DIFs GitHub project you would be better off just to email me at
<EMAIL_ADDRESS>for general advice.
On Mon, Nov 12, 2018 at 10:28 PM tommy1520<EMAIL_ADDRESS>wrote:

Thanks Robert
Sorry for the delay, recently i was able to get some help from more SQL
savvy people to run the query on the Saperion SQL server
I should be able to get the SQL query results to you (hopefully) sometime
this week
Will send it to you then
Sorry again for the delay, i hope you will still be willing to give me
some pointers regarding the migration process
That said, i there anything that i can to first on Sharepoint? Just as a
preparation for the migration
Thank you Robert
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/MadAboutImport/DIFS/issues/14#issuecomment-438050590,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AqJUD7_3EjdqWr--Gqq7NppNN5Oo9NP6ks5uufYKgaJpZM4XdeOV
.

Hi Robert, i tried sending an email to you but i am getting an email delivery failure

Hi Robert, email sent. There was a typo in the email address, luckily was you also included your correct email on your initial reply. Sharepoint platform is Sharepoint Online by the way
Out of curiosity, are you one of the devs for the DIFS tool?
Hope to hear from you soon


Added a description of how to back port changes to old versions

If you can, can you define this more generally instead of explicit versions.

Done. I hope it looks better.


Process and Syncing Break.

Hello Reddcoin Development Team,
I have noticed that when the Reddcoin wallet closes down, it does so warning the user not to shut Windows down while the wallet is exiting. However, there are "rare" moments when the program will exit and yet still remain alive in the Windows background processes for several minutes.  This can lead anyone who does not know how to check the background Windows processes - to see if Reddcoin has correctly shutdown - to unknowingly and accidentally to close their Windows operating system down while Reddcoin is still working.
I am convinced this can be the cause for the rare moments when the blockchain indexing can be "fractured" or "broken", so that the Wallet has to rebuild its blockchain. I refer to you to the subsequent problems raised from my former enhancement suggestion - #162, "Trouble or Progress?"
I would suggest the following improvement: - To have an additional program fired, when the Reddcoin wallet is closed down, which shows a splash screen - warning the user that the wallet is still shutting down and not to close down the operating system, until the wallet has properly closed down.

Thanks for the suggestion.
Have added to the development list

Bump.


Test for pr

Hey folks - lmk what you think about this

looks bad!

hello bestie! could you please elaborate? this isn't particularly useful feedback, likely stemming to the fact that you're a bad person

berwin is silly. i approve of pr.

looks great, han.

I have approval from everyone, merging pr


Vex to Allay not working

There seems to be an issue with this as well. I see that the vexes indicate a redstone signal when set up as explained by jsorrel. (activator rail and comparator), but when playing the note, nothing happens. And there are no errors.
Anyone else tested this?

https://github.com/TreeOfSelf/CarpetSkyAdditions-Reborn/commit/c6d2a4b4c4d0f1a581b4835a9ca3232c848ee568
Fixed


Chat - Not here page shows up when deleting message after returning from thread

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.62-0
Reproducible in staging?: Y
Reproducible in production?: N
If this was caught during regression testing, add the test name, ID and link from TestRail: N/A
Issue reported by: Applause - Internal Team
Action Performed:

Go to staging.new.expensify.com
Go to chat
Send a message
Right click on the message > Reply in thread
Click on the header subtitle link
Delete the message

Expected Result:
App will not show not here page
Actual Result:
App shows not here page. (until it returns to the same chat with the comment undeleted because of another known issue)
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android: Native
[x] Android: mWeb Chrome
[ ] iOS: Native
[x] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

https://github.com/Expensify/App/assets/78819774/a67f1e46-88fb-48c1-a258-c30e04223ea1
View all open jobs on GitHub

@blimpich  FYI I haven't added the External label as I wasn't 100% sure about this issue. Please take a look and add the label if you agree it's a bug and can be handled by external contributors

We think that this bug might be related to #vip-vsp

Proposal
Please re-state the problem that we are trying to solve in this issue.
Chat - Not here page shows up when deleting message after returning from thread
What is the root cause of that problem?
After deleting reportAction we stay on a  URL which contains deleted reportAction ID
What changes do you think we should make in order to solve the problem?
Add Navigation.navigate(ROUTES.REPORT_WITH_ID.getRoute(reportID)) after deleting comment
What alternative solutions did you explore? (Optional)

Not a deploy blocker. This seems to be an unhandled edge case from https://github.com/Expensify/App/pull/39454. When I revert that PR it isn't an issue. @rushatgabhane @rayane-djouah @jasperhuangg can you handle this as part of your work on https://github.com/Expensify/App/issues/38979?


System properties

We have key=value pairs that are written to files under the /proc/sys directory in Linux which are exposed as system properties in libcontainer. Does Windows have any such equivalent? I would imagine that registry setting might fit in there. If that is the case, then we could move system properties to the portable portion of the spec.

@taylorb-microsoft do you have any comments about Windows?

@mrunalp Does doing this add clarity or improve code sharing? I feel like we should just call it sysctl and put it in the Linux section. There are other key/value things like rlimits but I don't feel it makes sense to smash rlimits and sysctl together.

@philips I agree with you. I was trying to see if we could somehow add more to the portable section. I guess we can do that over time rather than forcing it now.

Windows does have policies, most commonly folks would think of group/local policy as an example of this (run gpedit.msc on any windows machines and you'll see a set of the local policies).  You would use those to specify such things as credential delegation or global networking polices or time servers as examples.  Ultimately those all turn into registry keys so you could see someone wanting to configure them as part of a build script (aka dockerfile) or some other such means as well.
We don't currently have plans to configure these as part of creating/starting a container but its something we could consider adding if customers desired that functionality in the future.

This has been resolved by #29


Expanded Readme

Expanded version of readme with new banner image and description of code modules.

Thanks to Abe Martin for the update.


conceal cause display issue for vim 7.4

Environment

Operating System: latest CentOS 7 x64, minimal install

Vim version :version:
using vim installed by yum install vim
VIM - Vi IMproved 7.4 (2013 Aug 10, compiled Apr 10 2018 23:54:40)
Included patches: 1-160, 399, 402-403, 1099

NERDTree version git rev-parse --short HEAD: latest (370eb5b)

NERDTree settings applied in your vimrc, if any:
nothing, just clean install and open nerdtree

Screenshot(s)
issue:

after set conceallevel=0 :

Please refer to #916


GO Pathways

In biolink there is a narrow mapping from Pathway to GO:0007165 (signal transduction) .  Assign the category Pathway to these terms.

Complete


Delete comments

Is there a way to delete comments?
Thanks in advance

@Bits4Bux
To delete a comment, you can use the delete_tweet method. Here is an example of how to do it:
python
コードをコピーする
client.delete_tweet(tweet_id_here)

@Bits4Bux
you can use delete_tweet method to delete comments.
await client.delete_tweet(tweet id here)

It worked, thank you :)


reserved identifier violation

I would like to point out that identifiers like "__FASTNOISE_H__" and "_ValueFractalFBM" do not fit to the expected naming convention of the C++ language standard.
Would you like to adjust your selection for unique names?

I will work on changing this.

Only private methods contain an underscore before the method name and reading the rule it seems to only apply to external links. Let me know if this is incorrect.

How do you think about to avoid that this software depends on undefined behaviour?

That doesn't answer my last question, I realise the header breaks the rules but the methods are private.

It does not matter which identifiers you would like to categorise as private.

Latest commit changes header define

Thanks for your renaming of an include guard.
There are a few update candidates left over.


Why doesn't GruntJS break execution if exception is thrown?

It seems like grunt-inline does't handle exceptions as described in the post http://stackoverflow.com/questions/41246030/why-doesnt-gruntjs-break-execution-if-exception-is-thrown

+1
When uglify fails there is no way of knowing the cause of the failure


Review publishing settings

@janwithb - Can you review the pyproject.toml regarding the E-Mail address you want to use (private vs commercial )? I have used my private one.

@cokeSchlumpf - Updated to private email


Retrieve recursive memberOf

hi,
is there any easy way to check for users in a search result whether one of their groups is member in a certain group? eg. through using OID 1.2.840.1135<IP_ADDRESS>1?
Eg. i've got a student user s.test who's member in a student group students. The group students now itself is also member in a permissions group DL_some_action_allowed.
Now i want to enrich my search results with the information whether or not s.test is a recursive member of DL_some_action_allowed to grant access to a certain function or not at best without any additional needed query for performance reasons. Thanks!

You would have better chance of someone answering this question on stackoverflow.com
This repo is specific to ldapjs for node.

Hi, maybe my question was a bit unclear, i'm asking for a way to enrich search results with an additional field containing recursive memberOf information.
I'm not simply asking how to filter for recursive membership explicitly.
In my understanding thats not a general ldap question but specific to this library, isn't it?

There is no easy way to do that in ldapjs. You just have to get the search results and run another search.
Ldapjs is meant to be a low level js implementation of ldap. There might be other npm packages that wrap ldapjs and provide higher level functions that do this.

alright, that answers my question! thank you.

⚠ This issue has been locked due to age. If you have encountered a recent
problem that seems to be covered by this issue, please open a new issue.
Please include a minimal reproducible example
when opening a new issue.


varlink: rmi of image with untagged layer: unexpected stdout

In window 1:
# ./bin/podman varlink --timeout 0  unix:/run/podman/io.podman

In window 2:
podman run --name c1 alpine touch /test_a
podman commit c1 i1
podman run --name c2 i1 touch /test_a1
podman commit c2 i2

# Remove containers
podman rm --force c1 c2

# Remove first image
podman-remote rmi i1

# i1 is still around, it's just untagged
podman-remote images -a

# This command will cause output on the varlink window (SHA of i1)
podman-remote rmi i2

Podman built from master, 7838a13b61e, on f29.

finally found the culprit is in image.go:360 ... putting this here for when I pick it up again.

Comparison of podman vs podman-remote behavior:
# podman run --name c1 alpine touch /test_a
# podman commit c1 i1
Getting image source signatures
Skipping blob 503e53e365f3 (already present): 5.52 MiB / 5.52 MiB [=========] 0s
Copying blob 587c5d809e91: 4.00 KiB / 4.00 KiB [============================] 0s
Copying config f9cd3c92c307: 773 B / 773 B [================================] 0s
Writing manifest to image destination
Storing signatures
f9cd3c92c3070c478b4aa398f56e11e42dddd0922ab743552e716e18efc9bf77
# podman run --name c2 i1 touch /test_a1
# podman commit c2 i2
Getting image source signatures
Skipping blob 503e53e365f3 (already present): 5.52 MiB / 5.52 MiB [=========] 0s
Skipping blob 587c5d809e91 (already present): 4.00 KiB / 4.00 KiB [=========] 0s
Copying blob 3d305faa3131: 1.50 KiB / 1.50 KiB [============================] 0s
Copying config 0d268077bd53: 893 B / 893 B [================================] 0s
Writing manifest to image destination
Storing signatures
0d268077bd53668045e16e34c1644abee1e45662a29346ad3878d7e98bb0d601
# podman rm --force c1 c2
5262006b8cb3c00044ac46027f83ae508b3a572ea294d31c207e5abb513ad7fd
821c57571d9a3dec6c13181b231b0974e81d57b490265241e2c64743c54ea70d
[ the above is the same in both cases. Below is the diff between podman & podman-remote]
----------------------------------------------------------------------------------------------------------------------
# podman rmi i1                        | # podman-remote rmi i1
Untagged: localhost/i1:latest          | [outputs the SHA of i1, even though that image isn't rm'ed]
# podman rmi i2                        | # podman-remote rmi i2
[sha of i1]                            | [sha of i2 -- SHA of i1 is output in the varlink window]
[sha of i2]

@edsantiago @baude @jwhonce Is this fixed now?

no, this is not a simple fix. i looked at it this morning and it is going to required more work that i have today.

@edsantiago @baude Any update on this?  Fixed still in progress? Forgotten?

Still present in d10f68ac95e13535f90d9b643ac2d7530178c21d.
FWIW the 'varlink' process is quite noisy; from a short test run, I get tons of output like:
# podman varlink --timeout=0 unix:/run/podman/io.podman
rm false
ERRO[0234] unable to find flag trace
ERRO[0234] unable to find flag syslog
rm false
ERRO[0235] unable to find flag trace
ERRO[0235] unable to find flag syslog
detach false
rm false

And, oh dear, podman-remote pull alpine is SEGVing.

I have a PR to fix this original report but i need to coordinate with the cockpit folks and we're not quiet there yet.

master is completely broken right now:
podman run --name c1 alpine touch /test_a
option parsing failed: Unknown option -n
Error: write child: broken pipe

Will check once that's fixed. (Will also file issue if one isn't already filed)

tested on master @ c93b8d6b02c7ec0c91af34481133001421b9628d; looks to be fixed. Thank you!


[WIP] Fixed #24935 -- Refactored conditional GET handling

first basis for discussion

buildbot, add to whitelist.

Is this still a work in progress? Anything in particular you wanted to discuss? That code is complicated so not sure I could give much feedback without a detailed review.  The tests passing is at least a good sign.

@syphar, any response to my previous question? It looks mostly good to me (some suggested cosmetic edits: http://dpaste.com/1CB3Q7J, and I think we might want to rename handle_conditional_get() to something like get_conditional_response() since "handle" doesn't have a clear meaning).
Does this enable new functionality (in which case it would be nice to have tests) or is it merely a refactoring?

@timgraham sorry, didn't see the original comment

it's definitely a refactoring (or, more exact a cleanup), as a preparation to fix some related bug that really annoyed me.
due to the fact that the conditional get handling was different in all the locations, the exact behavior in these locations definitely changes in detail. (like CommonMiddleware not checking the the preconditions, so it was never returning a PRECONDITION FAILED response).
same for returning the original response vs generating a new one. This also was handled differently.

Yes, I'm quite sure that due to the fact the testsuite still passes from all the previous locations, is a good indicator this is a very good change and cleanup in the code.
It changes functionality in detail though.
Question to me is if I should add tests for the detailed new behavior to all the places, or just test the one handle method in more detail.

A single set of tests seems okay to me.

I don't mind merging this as-is and leaving tests to future improvements. The outstanding question I have is about renaming handle_conditional_get() -- do you think get_conditional_response() is an okay name or would you choose something else?

merged in 7a40fef17ab7918cbb1ddc3ba080f42b420f7a48, thanks!


group tests into class

🚀 Feature
Now, we have quite extensive skip conditions for many tests which are mostly very similar to all test in a single file, so with grouping, we shall clearly mark some features/expectations
Motivation
reduce conditions so it easier to navigate
Pitch
https://github.com/PyTorchLightning/pytorch-lightning/blob/69123af3ea651a5e1cc25014da6f1c0dee433916/tests/metrics/regression/test_ssim.py#L49-L53

So are you talking about having ready-to-go wrappers? Like they do in PyTorch?
https://github.com/pytorch/pytorch/blob/1aaddd83a501743aad18f2f36da2ba9a2c3eb317/torch/testing/_internal/common_device_type.py#L25

well I was thinking about something simples, but that would be nice too

@Borda I could pick this up.

@Borda This is done, right?

no, but it just nice to have... and maybe after our RunIf not needed


Weekly totals

As of couple of days ago the weekly training totals are not showing up on my main profile page. screenshot attached.

Same here.
Stravistix 5.4.2 and Chrome 56.0.2924.87 (64-bit).

I will disable this since it's pretty hard to maintain when strava change their html DOM.
Don't worry you will be able to get this back through dashboard feature. Grid feature (90% done)  may also do the work. Please be patient ;)
Tom

Thanks Thomas. In that case it is better to disable it because the weekly/monthly statistics are completely hidden by the non working feature.


AY-6963_Shotgrid displays internal URL when runs on K8S-ASH

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior:
After switch from on-prem ASH to K8S-ASH, Shotgrid displays the internal URL of Ayon server in its settings instead of production instance (tenant.ayon.app)

Expected Behavior:
No response
Version
1.0.0
What platform you are running on?
Windows
Steps To Reproduce:
Use AYON AWS instance with K8S-ASH and sync your test Shotgrid project.
Are there any labels you wish to add?

[X] I have added the relevant labels to the bug report.

Relevant log output:
No response
Additional context:
No response

Hey @64qam where is this shown in SG?
Also, how this is effecting the synchronization?
Is this something which can be temporarily solved by manual configuration?


the version 0.57.5 of UnoCSS for VS Code doesn't work

UnoCSS version
0.57.5
Describe the bug
It has no prompt in version 0.57.5 and behaves as if it is not installed. After I tried rolling it back to version 0.57.4, it behaved normally and could provide completion prompts. I'm sure my uno.config.ts file is in the correct location, and the style can be displayed correctly in the browser. Has anyone encountered the problem as me?
Reproduction
the version 0.57.5 of UnoCSS for VS Code does not provide color preview

// uno.config.ts
import { defineConfig } from 'unocss'
export default defineConfig({})

System Info
System: Windows 11
Framework: Vite & Solidjs
IDE: VS Code
Validations

[X] Read the Contributing Guidelines.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[x] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

Hi, @MCheery
There is no problem on my side. You can try uninstalling and reinstalling. If you still have problems, can you provide a reproducible template so that I can copy it locally and reproduce it?

Hi, same thing happened to me. I also had to downgrade Vite from 5.0.0 to 4.5.0 (Vite & React / Mac). IntelliSense only was not working.

Seem, I installed the lower version (0.75.4), It is normal now

it will be fixed in the next version

Is this really fixed?
With 0.58 I'm still having very similar issues.
I have a file uno.config.js that is extremely basic, just the wind preset.
Looking at UnoCSS Output pane in VS Code, it seems to pick up the configuration file alright.
Everything is working fine in browser.
I get a lot of completions, but some are missing.
Notably, as the OP here, no colors are proposed on bg-.
Strangely, if I fully type a color like bg-red, it's fully recognized: it has the underline in code, the little red color dot, and the tooltip showing the matching CSS code. Same for bg-yellow or bg-yellow-200.
But if I start typing bg-r| nothing is proposed in completions.
Colors are obvious missing suggestions but I noticed a few others. For example bg-right is not proposed either in completions (but is still highlighted in IDE and works in browser).

Or maybe it's not the same problem after all. Reverting extension to 0.57.4 does not fix.
I'll add the strangely colors work in other contexts. E.g. text-y| suggests text-yellow, yet bg-y| doesn't suggests bg-yellow.

This problem is easy to observe in UnoCSS interactive documentation as well, I've opened https://github.com/unocss/unocss/issues/3450


iframeExtractor.js

Implement iframe extraction with error handling

Added validation for iframe input to ensure well-formed HTML.
Implemented try-catch blocks to gracefully handle extraction errors.
Enhanced logging for better error tracking.
Created fallback mechanism to avoid request processing failures.

This PR, unfortunately, doesn't solve the linked issue.
For inspiration, see other submissions (https://github.com/apify/crawlee/pull/2714/ , https://github.com/apify/crawlee/pull/2712)


[DF] Project step creates additional columns in cases where it may not be needed

What happened: There's additional memory footprint after the project step in some cases that need to be explored further
What you expected to happen: No extra columns created in certain cases
Minimal Complete Verifiable Example:
c.sql("SELECT a,b from table ORDER by a,b")

In the current execution, the plan projects and gets df.a and df.b from table but creates two new columns that map to the same values even though it's a reference.
During the sort phase of the execution, we effectively persist a dataframe with 4 columns instead of 2.
Anything else we need to know?: This was introduced during the datafusion port since the earlier calcite plan for a similar query didn't have a project phase for the same query and no additional columns were created

I'll take this. I think I know right where this is happening and why. I remember early on we didn't have RexType operators for references and therefore this was probably overlooked. Now that we do have reference types a check could be introduced to check for this and not create the new temporary column.

closed via #644


[feat] Add configurable conflict handling

Fix #139
Fix #140
This PR adds configurability for conflict handling. It's currently not exposed to the user, it's mostly a proof-of-concept for later adding a plugin system.
The OptimisticInsertInsertHandler is an example of an extension to conflict handling that previously was not there.

Codecov Report

Merging #141 into master will decrease coverage by 0.18%.
The diff coverage is 77.41%.

@@             Coverage Diff              @@
##             master     #141      +/-   ##
============================================
- Coverage     82.19%   82.01%   -0.19%
- Complexity      500      507       +7
============================================
  Files            38       41       +3
  Lines          1820     1840      +20
  Branches        269      271       +2
============================================
+ Hits           1496     1509      +13
- Misses          209      212       +3
- Partials        115      119       +4

Impacted Files
Coverage Δ
Complexity Δ

...a/se/kth/spork/spoon/conflict/ContentConflict.java
100.00% <ø> (ø)
5.00 <0.00> (?)

...e/kth/spork/spoon/conflict/StructuralConflict.java
85.29% <ø> (ø)
16.00 <0.00> (?)

.../kth/spork/spoon/pcsinterpreter/ContentMerger.java
80.00% <ø> (ø)
36.00 <0.00> (ø)

...h/spork/spoon/pcsinterpreter/SpoonTreeBuilder.java
87.96% <ø> (-0.76%)
42.00 <0.00> (-1.00)

...a/se/kth/spork/spoon/pcsinterpreter/SporkTree.java
87.50% <ø> (ø)
15.00 <0.00> (ø)

...e/kth/spork/spoon/printer/PrinterPreprocessor.java
83.75% <ø> (ø)
19.00 <0.00> (ø)

...se/kth/spork/spoon/printer/SporkPrettyPrinter.java
88.73% <ø> (ø)
24.00 <0.00> (ø)

.../spoon/conflict/MethodOrderingConflictHandler.java
50.00% <50.00%> (ø)
6.00 <6.00> (?)

.../spoon/conflict/OptimisticInsertInsertHandler.java
75.00% <75.00%> (ø)
5.00 <5.00> (?)

...rc/main/java/se/kth/spork/spoon/Spoon3dmMerge.java
98.54% <100.00%> (+0.01%)
20.00 <0.00> (ø)

... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ba51013...f388e3c. Read the comment docs.


document using clang-format for Closure Library pull requests

Done. https://github.com/google/closure-library/wiki/Formatting-.js-with-clang-format


Simple Invoke-Command script doesn't return data from remote PC correctly

Pretty much what title says. When invoking from one workstation simple Get-ChildItem on remote PC, the Powershell 7.0.3 session  neither returns nor renders the content of given drive which is unexpected (see the screenshots provided below). Running the same script in Windows powershell 5.1 session works just fine.
Steps to reproduce
Two workstations in the same network. One is Win10 Pro x64 v1903 with PS 7.0.3, the second is on Windows 7 SP1 x64 with PS 2.0
Remoting is enabled and working. WSMan's TrustedHosts - all hosts allowed on both WS.
Invoke-Command -ComputerName <IP_ADDRESS> -ScriptBlock { Get-ChildItem 'C:\' } -credential DocsUser

Expected behavior
Like when run on PS 5.1:
![2020-08-12 13_50_11-Window](https://user-images.githubusercontent.com/25516639/90009510-dc7bbc80-dca6-11ea-9da4-b0bb4d97bca5.png)

Actual behavior
Powershell 7.0.3:
![2020-08-12 13_49_59-Window](https://user-images.githubusercontent.com/25516639/90009575-f7e6c780-dca6-11ea-823b-033859d167e8.png)

Environment data

Windows 10 workstation:
Name                           Value
----                           -----
PSVersion                      7.0.3
PSEdition                      Core
GitCommitId                    7.0.3
OS                             Microsoft Windows 10.0.18363
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

Windows 7 workstation:
Name                           Value
----                           -----
CLRVersion                     2.0.50727.8669
BuildVersion                   6.1.7601.23403
PSVersion                      2.0
WSManStackVersion              2.0
PSCompatibleVersions           {1.0, 2.0}
SerializationVersion           <IP_ADDRESS>
PSRemotingProtocolVersion      2.1

IIRC this was an issue with the codeproperties the formatter tries to use or something. I'm pretty sure this got fixed fairly recently. Can you test on the latest preview release to be sure, though? 🙂

The latest one I found is PowerShell 7.1.0 Preview 3. Alas, the issue still there for that version.

Alas, the issue is still there for 7.1.0 preview 5.

@vexx32 I think you're right about formatter, since when I added "| Format-table" after "gci" the returned output is OK. But I suppose it's still the issue, since it should work without any additional actions/formats.

Ah, knew I'd seen it before. There's a bit more info in #11400.
Reading back through that discussion, sounds like the most promising option would be to duplicate the format view definitions for System.IO.FileInfo and System.IO.DirectoryInfo and explicitly declare the same formatters for their deserialised versions to account for this.
I'll mark this as duplicate for now. If you're interested in looking at a fix yourself, I can point out the relevant code areas where the formatting is handled. If not, I might have a look in a while myself; it'd be good to get this fixed for 7.1. 🙂


Setting ASPNETCORE_ENVIRONMENT to the value containg '.' (dot char) gives "Invalid environment setting" error

When hosted by IIS, at
var builder = new ConfigurationBuilder()
    .SetBasePath(env.ContentRootPath)
    .AddJsonFile("appsettings.json", optional: false, reloadOnChange: true)
    .AddJsonFile($"appsettings.{env.EnvironmentName}.json", optional: true, reloadOnChange: true);

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at Microsoft.Extensions.Internal.ActivatorUtilities.ConstructorMatcher.CreateInstance(IServiceProvider provider)
   at Microsoft.AspNetCore.Hosting.Internal.StartupLoader.LoadMethods(IServiceProvider hostingServiceProvider, Type startupType, String environmentName)
   at Microsoft.AspNetCore.Hosting.WebHostBuilderExtensions.<>c__DisplayClass1_0.<UseStartup>b__1(IServiceProvider sp)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitScoped(ScopedCallSite scopedCallSite, ServiceProvider provider)
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.<>c__DisplayClass16_0.<RealizeService>b__0(ServiceProvider provider)
   at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProvider provider, Type serviceType)
   at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProvider provider)
   at Microsoft.AspNetCore.Hosting.Internal.WebHost.EnsureStartup()
   at Microsoft.AspNetCore.Hosting.Internal.WebHost.EnsureApplicationServices()
   at Microsoft.AspNetCore.Hosting.Internal.WebHost.BuildApplication()
Hosting environment: a.b

If I remove the dot (and rename settings file accordingly) everything works just fine.

What was the actual exception type and message?

Application startup exception: System.InvalidOperationException: Invalid environment setting 'a.b'

I cannot repro your issue. Can you post a repro app for us to debug?

I'm really sorry but the issue was between the chair and the keyboard ;)

Haha, alright then. Will close.


Bug fix: GitHub import with different languages in private repos

Fixes: https://github.com/microsoft/pxt-microbit/issues/5389
The Root Cause
TL;DR: We needed to follow the same steps for decoding content that we do for encoding content.
As the issue notes, the problem was with how we compare the SHAs generated from parsing the text from the files in GitHub repositories. When a user creates a new repo from one of our targets, we convert the text to UTF-8 and then use btoa to base64 encode the content: https://github.com/microsoft/pxt/blob/master/pxtlib/github.ts#L412. If a user then deletes that repo and imports it back into the target, we were only using atob to decode the contents, meaning that there would be inconsistencies in the text that upon importing if there were any non-ASCII characters in any files: https://developer.mozilla.org/en-US/docs/Web/API/Window/atob. Since the file that we parsed is not the same that Github returned to us, we throw an error saying that the SHA was corrupted, even though the text content was the same other than the non-ASCII characters. (You can find this logic here: https://github.com/microsoft/pxt/blob/2805be15c19b420cb8413b29adc3712dd425d424/webapp/src/workspace.ts#L1215-L1241)
I was stuck on what to do for a bit because I thought that Github was doing something weird with the encoding that we wouldn't be able to counter-act. But once I realized that we were encoding the content ourselves before creating the repos, I realized it was something that we could control. Since we convert to UTF-8 and then encode when creating the files, we need to make sure that when we're importing the files back, we do the reverse by decoding the base64 and then converting it to UTF-8. So, we do not need to make the extra http request every time like I thought we would in stand-up, just need to add an extra decoding step when fetching the content.
This was only a problem with private repos because private repos go through the fallbackDownloadTextAsync function where we need to more manually get the content. We can successfully grab the content from public repos on the first download try: https://github.com/microsoft/pxt/blob/master/pxtlib/github.ts#L307-L312. Private repos use a url that is a bit different: https://github.com/microsoft/pxt/blob/master/pxtlib/github.ts#L284-L297.
Upload target: https://makecode.microbit.org/app/0f4d7c2e58d76a70d0b90c60721cac39b7736249-4132a16546#
If you want to test it, I recommend following the steps listed on the issue.

Nice fix


[Backend] Privacy Experiences Basic Endpoints

Closes #3151
Code Changes

[x] Add an endpoint to bulk create privacy experiences
[x] Add an endpoint to bulk update privacy experiences
[x] Add an endpoint get the detail of an individual privacy experiences.  Privacy notices are returned embedded in the response.

Steps to Confirm

[ ] Try creating, updating, and retrieving privacy experiences via postman.  If you create notices too, you should see relevant notices embedded in the response

Pre-Merge Checklist

[ ] All CI Pipelines Succeeded
Documentation:

[ ] documentation complete, PR opened in fidesdocs
[ ] documentation issue created in fidesdocs

[ ] Issue Requirements are Met
[ ] Relevant Follow-Up Issues Created
[ ] Update CHANGELOG.md
[ ] For API changes, the Postman collection has been updated

Description Of Changes
Add API endpoints to bulk create/update/get privacy experiences.  There is very little validation on the types of experiences created here.

Update added @allisonking so you can hopefully update selected experience fields. Also i think this is ready for review!


Add Softplus activation layer

Current coverage is 43.13% (diff: 0.00%)

Merging #19 into master will decrease coverage by 1.21%

@@             master        #19   diff @@
==========================================
  Files            27         28     +1
  Lines           496        510    +14
  Methods         486        500    +14
  Messages          0          0
  Branches         10         10
==========================================
  Hits            220        220
- Misses          276        290    +14
  Partials          0          0

Powered by Codecov. Last update 7c891a0...7384313


Create formatters, signers and backends per process

Changes

This PR refactors the creation of all the formatters, signers and backends that we need to create, sign and store taskrun's payload. Instead of creating them per request in the SignTaskRun function, we create them per process. Specifically, they are created at the controller level. Only when the configmap is updated, they will be updated.
Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[ ] Docs included if any changes are user facing
[x] Tests included if any functionality added or changed
[x] Follows the commit message standard
[x] Meets the Tekton contributor standards (including
functionality, content, code)
[ ] Release notes block below has been filled in or deleted (only if no user facing changes)

Release Notes

/retest

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-build-tests

/assign @wlynch

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-unit-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-unit-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-unit-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/test pull-tekton-chains-integration-tests

/assign @priyawadhwa

/lgtm


Game microfrezzes and sometimes it doesn't translate the dialogue

So yeah, any dialogue causes the game to "freeze" for few frames, sometimes the dialogue doesn't get translated, what's the issue here? Sorry english is not my primary language

Hello!
The micro-freezes are due to some sync code i'm refactoring to async.
The missing translation every now and then is due to an error in google translate API response. I noticed it too and it is already fixed for the next release.

having same problem over here, lot of microfreezes

Closing this as it is a known issue and it is being reworked. No ETA to release the fixes but I ask you to bear with us.


add label-schema.docker.cmd

label-schema.org has a docker.cmd property. Adding an example docker command into it

@biggianteye will rebase when php7 is fixed


Add info on what to do on first run

Just to simplify things for the newcomer (me) add something like this to the README:

Once you've successfully run run-taiga.sh start a web browser and point it to http://localhost:80.  You should be greeted by a login page.  The administrators username is admin, and the password is 123123.

You could have created a PR... but thanks, I'm adding it now :)

added!


LSCP  Notebook Plots

spopt -> notebooks -> lscp.ipynb
cells 19, 20, 21
plot_results(lscp_from_cost_matrix, facility_points) should be plot_results(lscp_from_cost_matrix, facilities_snapped) ?
I'm happy to make the amendments and add to my pull request if you agree.

Yeah, just to plot the original observation points. Although the from_geodataframe uses the snapped points in the model, I thought to use snap operation only to take the distance between clients and facilities.
I think we can add a plot to show the snapped locations and add a description of the "real" plot to state the differences. Subplots maybe would be a great idea in this case.


DocType Date field is timezone naive

It appears that any document stored with an ISO8601 date will be tzlocal, regardless of the stored timezone, when retrieved.  There are a couple possible solutions, and I'm willing to make a pull request if one of them is acceptable:
http://crsmithdev.com/arrow/ -- I use this quite a bit, and like it
https://pypi.python.org/pypi/iso8601/ -- I haven't used this, but it seems sufficient

I see different results - in d83d49e6987ad413f1ae08dc8044f702cc4b2e90 you can see that a datetime created with a timezone information comes back as timezone-aware. Is there something I am missing?
Thanks!

My apologies.  I reviewed my integration test, and think I may have had a mapping or some other problem.
John
<EMAIL_ADDRESS>@jxstanford

On Feb 26, 2015, at 14:04:17, Honza Král<EMAIL_ADDRESS>wrote:
I see different results - in d83d49e https://github.com/elasticsearch/elasticsearch-dsl-py/commit/d83d49e6987ad413f1ae08dc8044f702cc4b2e90 you can see that a datetime created with a timezone information comes back as timezone-aware. Is there something I am missing?
Thanks!
—
Reply to this email directly or view it on GitHub https://github.com/elasticsearch/elasticsearch-dsl-py/issues/77#issuecomment-76284285.

Closing the issue then, thanks


Fixed price break row actions after sorting

To reproduce the issue:

Navigate to supplier page view
Sort the price break table by quantity or price
Click on "edit" or "delete" button on a row, it wouldn't do anything

Seems like onPostBody event handler handles sorting better than onLoadSuccess would do.
Reference: https://bootstrap-table.com/docs/api/events/#onpostbody
Note: onLoadSuccess is also used in bom.js, build.js and stock.js files for respective bootstrap tables but have not looked those up to see if onPostBody would fit better there too.

Thanks @eeintech - I agree that onPostBody is more appropriate here.


Update DBMS compatibility

Purpose
Update DBMS compatibility to include oracle RAC.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Mutiple duplicated Notice will be returned even if it is the same function that gets used multiple times in the same query

Describe the bug
For example, if a query contains multiple array_agg, it will return:
NOTICE:  array_agg without ORDER BY may produce non-deterministic result

multiple times
Error message/log
No response
To Reproduce
No response
Expected behavior
No response
How did you deploy RisingWave?
No response
The version of RisingWave
No response
Additional context
No response

I guess we can at least do some deduplication by comparing the notice messages. 😕


Add can_remove_subscribers_group stream setting.

First commit adds can_remove_subscribers_group field, which can be null as of this commit.
Next commit is to fix import related code by importing user group model before stream model.
Next commit is to set can_remove_subscribers_group setting when creating streams.
Next two commits are to add a migration to set the setting for existing fields and then changing the setting to be not null.
Last commit adds code to allow removing subscribers based on the newly added setting.

Fixes:  Part of #19525.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

I merged 4 prep commits as the series ending with e83ea8b6a78d8372f99f3fa8c1028f8258b73205, after addressing a commit message typo in the last one. Thanks @sahil839! Let's try to settle #22352 in the next couple days and go from there.

I guess we can rebase this now that #22352 is integrated!

@timabbot would be nice to complete this so we can move forward. I have left one question for the import related code.

@timabbott updated the PR to fix the import code.

Last push was to just update the commit message.

This is great; I intend to merge after making the tiny expect_fail change noted above. Huge thanks for doing this @sahil839!
I think probably a reasonable next step might be prototyping a dropdown_list_widget based UI for displaying and changing this setting?


Multi-API: add resource type for appservice for consistency

[x] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

[x] I adhere to the Command Guidelines.

I think it is good whenCI check pass.


Can I pin my favorite tags?

As the biggest user for Lepton (author), I would like to pin my favorite tags at the top of the tag list, so that I can save the time on scrolling.

Done: https://github.com/hackjutsu/Lepton/commit/266e589ada7d67381761c6068f9b2f3cf38e9f0c


Fixtures that are used in pytest.fixture(params=[...]) are marked as unused

I am using this approach in some of my fixtures:
@pytest.fixture()
def async_wrapper():
    """Fixture to convert all regular functions into async ones."""
    def factory(template: str) -> str:
        return template.replace(
            'def ', 'async def ',
        ).replace(
            'with ', 'async with ',
        ).replace(
            'for ', 'async for ',
        )
    return factory

@pytest.fixture()
def regular_wrapper():
    """Fixture to return regular functions without modifications."""
    def factory(template: str) -> str:
        return template
    return factory

@pytest.fixture(params=['async_wrapper', 'regular_wrapper'])
def mode(request):
    """Fixture that returns either `async` or regular functions."""
    return request.getfixturevalue(request.param)

And pytest --dead-fixtures marks both of them as unused:
» pytest --dead-fixtures --dup-fixtures

Hey there, I believe the following fixture(s) are not being used:
Fixture name: async_wrapper, location: tests/test_visitors/conftest.py:65
Fixture name: regular_wrapper, location: tests/test_visitors/conftest.py:79

What can be done to suppress this error?
Source code: https://github.com/wemake-services/wemake-python-styleguide/blob/master/tests/test_visitors/conftest.py#L64-L89
Related: https://github.com/wemake-services/wemake-python-styleguide/issues/1017

Due to the dynamic lookup that happens during execution of the fixture function, I assume this case will be difficult to recognize.
I at least added a unit test to cover this edge case (false positive) and refer back to this ticket: https://github.com/jllorencetti/pytest-deadfixtures/pull/31

Any workaround for that case?
I think https://github.com/jllorencetti/pytest-deadfixtures/pull/23 can help solve it manually (per project)
Like per-file-ignore in setup.cfg
used-fixtures-per-file =
   tests/conftest.py:async_wrapper,regular_wrapper


Configure workspaces correctly

Working through configuring this as a very minimal monorepo to streamline dependency installation and management between the example directory for testing and the package directory for writing the code intended to be published.
Laying this groundwork will help users get started with a robust development environment out the door.

referencing https://github.com/mirror-xyz/degen/tree/main
this repo.
Along with the private @zoralabs monorepo.
...Also trying to not overcomplicate things. But establishing this development environment is pretty important imho.

@Javier-Szyfer @0xTranqui @salieflewis appreciate any feedback on this point.


Do not prompt constant functions to run as initializers

When running zos create, the CLI prompts with a list of contract functions to run as initializers. Only non-constant functions should be included in this list. Same for updating.
In the example below, the version function is flagged as pure:

@jcarpanelli I'm not sure if this was actually fixed in master as part of another PR. Let me know if that's the case!

This has been solved on https://github.com/zeppelinos/zos/pull/853, We should port that change to the release/2.3 branch though.

How difficult is it to port it, without bringing in the whole call command? If it's not too much effort, could you send a PR aimed at release/2.3 with it?

Fixed in #879


Write different columns to the same column family

Hi I have the same issue with this stackoverflow thread:
Spark-HBase ==> How to load different columns to the same column family in HBase using spark?
I keep getting errors saying "column family already exists"
can someone explain how I can create a new table with the catalog that having multiple columns per column family?

There is a similar thread for this issue: https://github.com/hortonworks-spark/shc/issues/44

Correct, @weiqingy @Fija Getting same error.
Source code:
import org.apache.spark.sql.{DataFrame, SQLContext}
import org.apache.spark.{SparkConf, SparkContext}
import org.apache.spark.sql.execution.datasources.hbase._
def empcatalog = s"""{
|"table":{"namespace":"empschema", "name":"emp"},
|"rowkey":"key",
|"columns":{
|"empNumber":{"cf":"rowkey", "col":"key", "type":"string"},
|"city":{"cf":"pdata", "col":"city", "type":"string"},
|"empName":{"cf":"pdata", "col":"name", "type":"string"},
|"jobDesignation":{"cf":"pdata", "col":"designation", "type":"string"},
|"salary":{"cf":"pdata", "col":"salary", "type":"string"}
|}
|}""".stripMargin
case class HBaseRecordEmp(
empNumber:String,
city:String,
empName:String,
jobDesignation:String,
salary:String)
val data = (4 to 10).map { i => {
val name = s"""Bobby${"%03d".format(i)}"""
HBaseRecordEmp(i.toString,
s"MyCity",
name,
"worker",
"5000")
}
}
sc.parallelize(data).toDF.write.options(Map(HBaseTableCatalog.tableCatalog -> empcatalog, HBaseTableCatalog.newTable -> "5")).format("org.apache.spark.sql.execution.datasources.hbase").save()
Error:
scala> sc.parallelize(data).toDF.write.options(Map(HBaseTableCatalog.tableCatalog -> empcatalog, HBaseTableCatalog.newTable -> "5")).format("org.apache.spark.sql.execution.datasources.hbase").save()
java.lang.IllegalArgumentException: Family 'pdata' already exists so cannot be added
at org.apache.hadoop.hbase.HTableDescriptor.addFamily(HTableDescriptor.java:827)
at org.apache.spark.sql.execution.datasources.hbase.HBaseRelation$$anonfun$createTable$1.apply(HBaseRelation.scala:98)
at org.apache.spark.sql.execution.datasources.hbase.HBaseRelation$$anonfun$createTable$1.apply(HBaseRelation.scala:95)
at scala.collection.immutable.List.foreach(List.scala:381)
at org.apache.spark.sql.execution.datasources.hbase.HBaseRelation.createTable(HBaseRelation.scala:95)
at org.apache.spark.sql.execution.datasources.hbase.DefaultSource.createRelation(HBaseRelation.scala:58)
at org.apache.spark.sql.execution.datasources.DataSource.write(DataSource.scala:457)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:211)
... 50 elided

I got the same problem, and fixed it by a trival patch https://github.com/scrapinghub/shc/commit/d73da66

@lins05 Can you submit a PR including unit tests covering the change for this? Thanks.

Thanks, @lins05 . Fixed by PR#77, so close this. All credit of PR#77 should go to @lins05.

Thanks guys.
On Wed, Jan 11, 2017 at 11:47 AM, Weiqing Yang<EMAIL_ADDRESS>wrote:

Closed #62 https://github.com/hortonworks-spark/shc/issues/62.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/hortonworks-spark/shc/issues/62#event-918635580, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AGhRk1pJqITRd5fhd2QFRTHCYqrtaKTNks5rRHP8gaJpZM4LJfFD
.

--
Yours Aye,
Chetan Khatri.
M.+91 76666 80574
Data Science Researcher
INDIA
Statement of Confidentiality
————————————————————————————
The contents of this e-mail message and any attachments are confidential
and are intended solely for addressee. The information may also be legally
privileged. This transmission is sent in trust, for the sole purpose of
delivery to the intended recipient. If you have received this transmission
in error, any use, reproduction or dissemination of this transmission is
strictly prohibited. If you are not the intended recipient, please
immediately notify the sender by reply e-mail or phone and delete this
message and its attachments, if any.

So by default this patch is included by
$SPARK_HOME/bin/spark-shell --packages com.hortonworks:shc:1.0.0-2.0-s_2.11 --repositories http://repo.hortonworks.com/content/groups/public/
or what would be the work around ?

@chetkhatri The patch has not been included in the packages in Hortonworks public repo. We will include this patch to next release. Before that, you can compile branch-2.0 with the command line mvn clean -Pscala-2.11 -DskipTests package to get the jar.

Yeah, That's working

@weiqingy I am getting below error:
hduser@chetan-RH0108-E460:/home/chetan/Documents/hortonworks-shc/shc$ mvn clean -Pscala-2.11 -DskipTests package
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] HBase Spark Connector Project Parent POM
[INFO] HBase Spark Connector Project Core
[INFO] HBase Spark Connector Project Examples
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building HBase Spark Connector Project Parent POM 1.0.2-2.0-s_2.11-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ shc ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ shc ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] HBase Spark Connector Project Parent POM ........... FAILURE [  0.733 s]
[INFO] HBase Spark Connector Project Core ................. SKIPPED
[INFO] HBase Spark Connector Project Examples ............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.876 s
[INFO] Finished at: 2017-01-17T13:29:47+05:30
[INFO] Final Memory: 9M/143M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project shc: Error finding remote resources manifests: /home/chetan/Documents/hortonworks-shc/shc/target/maven-shared-archive-resources/META-INF/NOTICE (No such file or directory) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Cheers!
Thanks, @chetkhatri .

@weiqingy I am getting error 'error: not found: value HBaseTableCatalog' , I also doubt why it build jar at examples directory. steps are at previous comment.

@chetkhatri
You may want to try this in the step 2: go to /hortonworks-shc/shc/ instead of /hortonworks-shc/shc/core. '
In SHC, there are two sub-models:
  <modules>
    <module>core</module>
    <module>examples</module>
  </modules>

So there will be two jars produced (One module <-> one jar). When user want to use SHC, they just need to include the jar of core module into their class path.

Tried #69


OpenAPI JSON Serialization

Implementing serialization (but not deserialization) for OpenAPI. Partial #85.

Adding a comparer for component names (improves #80).
Adding implicit operations for Referable<> where applicable.
Change Parameter to ParameterBody for Operation.

Codecov Report

Merging #94 into master will increase coverage by 2.96%.
The diff coverage is 85.71%.

@@            Coverage Diff             @@
##           master      #94      +/-   ##
==========================================
+ Coverage   71.47%   74.43%   +2.96%
==========================================
  Files         123      126       +3
  Lines        4939     5469     +530
==========================================
+ Hits         3530     4071     +541
+ Misses       1409     1398      -11

Impacted Files
Coverage Δ

...ourceCode.Clay.OpenApi/Builders/CallbackBuilder.cs
41.93% <100%> (+1.93%)
:arrow_up:

...urceCode.Clay.OpenApi/Builders/ParameterBuilder.cs
90.47% <100%> (+0.47%)
:arrow_up:

...Code.Clay.OpenApi/Builders/ParameterBodyBuilder.cs
93.1% <100%> (+0.24%)
:arrow_up:

...rc/SourceCode.Clay.OpenApi/Builders/LinkBuilder.cs
90.47% <100%> (+0.47%)
:arrow_up:

...ceCode.Clay.OpenApi/Builders/RequestBodyBuilder.cs
89.47% <100%> (+0.58%)
:arrow_up:

src/SourceCode.Clay.OpenApi/Operation.cs
100% <100%> (ø)
:arrow_up:

src/SourceCode.Clay.OpenApi/Referable.cs
60% <100%> (+6.15%)
:arrow_up:

...rc/SourceCode.Clay.OpenApi/Builders/PathBuilder.cs
95.74% <100%> (+0.09%)
:arrow_up:

...SourceCode.Clay.OpenApi/Builders/ExampleBuilder.cs
88.88% <100%> (+0.65%)
:arrow_up:

...ourceCode.Clay.OpenApi/Builders/ResponseBuilder.cs
91.66% <100%> (+0.36%)
:arrow_up:

... and 29 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8d55dfe...046b69b. Read the comment docs.


ARROW-14825: [C++] Temporal component extraction function for extracting epiyear

This is to resolve ARROW-14825.

Would us_year be a better name as it's consistent with already present us_week name?

us_year seems to better in that regard. (Looking it up - it turns out "epiweek" means something different in the US vs the rest of the world? Oof.)

us_year seems to better in that regard. (Looking it up - it turns out "epiweek" means something different in the US vs the rest of the world? Oof.)

Well we're looking to mirror lubridate's epiyear for our R implementation, see ARROW-14824.
We could also call it us_epiyear to preventively disambiguate.

us_epiyear makes sense.

@lidavidm Switched to us_epiweek.

Ah, the function doc description needs to be line-wrapped.

Fixed.

Should there then also be an equivalent epiweek kernel?

@jorisvandenbossche we currently have us_week and iso_week. us_week is us_epiyear-like. We kind of have two camps here - iso and us/epi. Very much open to suggestions on naming here.

OK, I see. For consistency with us_week, could then also call it us_year? Or is that too vague?

The "us_week" was also a new invented name at the time? (or is that used elsewhere)

The "us_week" was also a new invented name at the time? (or is that used elsewhere)

So was assume_timezone. I suppose we've crossed that threshold. I'll change to us_year.

@jorisvandenbossche done.


Edit Existing Data

As a user, I want to push an “Edit” button on a data entry, so that I can make changes to an existing entry.

Users can click the Edit link next to a specific existing data point to edit fields of the data point.


Re-design the CLI interface

This PR includes a re-design of the command-line interface, most notably adding a flash subcommand.
In the current interface, since there is no flashing subcommand, it's possible to pass arguments before a subcommand which are accepted but silently ignored. This is bad UX and is a common source of confusion for users. Adding a flashing subcommand eliminates this issue entirely.
While I was breaking things, I did a bit of refactoring as well. This was mostly just moving types to the module they belong in, simplifying some functions, etc. Nothing too interesting. I've also renamed a number of types/fields/functions/etc. to be more in line with other parts of the code, eg.) CLI arguments now use arg instead of opt, as their types are even clap::Arg.
Additionally I have created a cli feature which all CLI-related dependencies are gated behind. This allows these packages to be excluded when using espflash as a library. This feature is enabled by default. The executable was renamed from main.rs to bin/espflash.rs to accommodate this.
Beyond addressing whatever changes are requested, I'm not sure that there is much more to add to this PR. There are additional UX-related changes I would like to make but they are out of scope and deserve their own PRs, I think.
I would like to spend some time reviewing this and really picking it apart before we merge it. I have marked this as a draft until I am comfortable with its state. Small details such as short/long names, docstrings (which are displayed in help messages) and argument names are important, so please nitpick!
Closes #222
Closes #236

hi @jessebraham I come here via esp-rs chat channel. Its clear that I'm totally newbie, so please forgive if I have some naive questions 😅. Is there any reasons you decided to switch from tracing-subcriber crate to env-logger?

@hnidoaht-101 for context, tracing-subscriber was added in a recent PR, we did not have any logging prior and I just really didn't scrutinize this inclusion (partially because I was already working on revamping the CLI anyways, so it didn't really matter much).
env-logger is what I would normally use in these situations, and it's a much simpler package. I frankly had never even heard of tracing-subscriber before that PR, so if there is some tangible benefit in using it then I would consider reverting, but I'm not sure what said benefit(s) would be.

Haven't looked much into this yet but definitely thumbs-up for adding a flash command and the other changes described here

Thanks for taking a look!
I wasn't sure when to bump the version, I can set it to 2.0.0-dev for now though I suppose. I do plan on submitting a handful more PRs prior to releasing (mostly just refactoring, but now is the time to break public APIs if we're gonna do it!)


support quality layer encoding?

Does this version support quality layer encoding? I only saw the spatial and temporal layers in the encoding extension parameter settings. Can you tell me where to set it?

Till now there's no plan to support CGS/MGS/FGS coding in openh264. Thanks for your interest on it.


Batocera freeze if a single ROM scraping doesn't work due to an API issue.

For the first time today I experienced a strange issue: while the scraping of an entire set works well as usually, a single ROM
scraping freezed the system! The background music theme was playing as usually, but buttons and joysticks do not reacted anymore.
I was forced to do an hard shut down the system pushing the reset button
Some discord users has told me that it was an API issue, but the system should not freeze anyway when the scraping is not working!
Today everything is back to normality, but I do not understand how a scraping failure can freeze the entire system.
I use Linux 6.3.6 with Batocera latest version (actually 37c 2023/06/17), DELL mini-atx board with CPU Intel i5-4570, 8MB RAM.

I can't reproduce, sorry.


Test/trino query

Creates simple test case which runs against a table, emptest, and verifies the column names.
The connection url is set in the test-settings.properties filename, which looks like the following.
db.url=jdbc:trino://mymachine

pom
needs to be sorted
trino-jdbc unused dependency
TestJTOpenPlugin
imports need ordered
extra carriage returns
curly brackets in wrong place
correct indentations
JUnit 4? Why not JUnit 5 with import static org.junit.jupiter.api.Assertions.fail;?


Commands are not respecting options

Something seems to have changed with the update to commander; the options are not being respected.
For instance rtm url -o 3345 will display the tasks URL, but it will not open.
I think that commander changed (in the 8 versions we jumped) how options are passed back.
This line for makes the urls work, but it seems kludgy. Line 26
  OPEN = env._optionValues.open === undefined ? false : env._optionValues.open;

Maybe I just roll back to the prior version. That was working albeit 8 versions back...


airline#extensions#xkblayout#short_codes changed to global for easily…

… redefine long named keyboard layout,
for example in .vimrc:
let g:airline#extensions#xkblayout#short_codes = {'Russian-Phonetic': 'RU', 'ABC': 'EN'}

please document the new variable et g:airline#extensions#xkblayout#short_codes

I slightly changed it a bit and pushed a squashed version. Thanks