Change decoder

This pull request adds 3 changes:

Moves Sslhandler to only be initialized if using Ssl. We had this change before, but it got lost because we had to revert some other changes.

We suspect there might be some leak in SslHandler. Netty 4 added a new SslHandler which uses a finalizer to clean up the engine. This does something similar, where we use a handler with a finalizer instead

Cleans up the Plaintext switching logic to how it was meant to be used. Returns a channelbuffer instead of firing the message on our own. The FrameDecoder will take care of firing the message for us.

lgtm


[5.9] Serialize package and SPI doc comments in swiftsourceinfo

5.9 cherry-pick of https://github.com/apple/swift/pull/65265

Explanation: Allows documentation comments on package and SPI declarations to be accessible to local clients that have access to the serialized swiftsourceinfo.
Scope: Affects editor functionality for references to SPI and package decls.
Issue: rdar://108601688
Risk: Low/Medium, this patch does include quite a bit of refactoring, but the change itself is otherwise quite straightforward, we now just include SPI and package decls when serializing swiftsourceinfo, which should have little risk.
Testing: Added tests to test suite.
Reviewers: Ben Barham, Alex Hoppen, Victoria Mitchell

@swift-ci please test

@swift-ci please test


pact-jvm-provider-junit messaging tests fail when run via maven

See this repo for an example: https://github.com/Fitzoh/pact-jvm-maven-test-issue
If you clone the project and run ProviderMessageTestthrough intellij, it will pass.
However, it run run the tests via maven (mvn test) it fails with the following message:

Verifying a pact between consumer and provider
  a test message
      Verification Failed - No annotated methods were found for interaction 'a test message'

Failures:

0) a test message
      No annotated methods were found for interaction 'a test message'

Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.946 sec <<< FAILURE!
consumer - a test message(com.example.ProviderMessageTest)  Time elapsed: 0.327 sec  <<< FAILURE!
java.lang.AssertionError:
0 - No annotated methods were found for interaction 'a test message'
        at au.com.dius.pact.provider.junit.target.BaseTarget.getAssertionError(BaseTarget.java:84)
        at au.com.dius.pact.provider.junit.target.AmqpTarget.testInteraction(AmqpTarget.java:51)
        at au.com.dius.pact.provider.junit.InteractionRunner$2.evaluate(InteractionRunner.java:181)
        at au.com.dius.pact.provider.junit.InteractionRunner.run(InteractionRunner.java:141)
        at au.com.dius.pact.provider.junit.PactRunner.runChild(PactRunner.java:101)
        at au.com.dius.pact.provider.junit.PactRunner.runChild(PactRunner.java:51)

This is a classpath issue when run from maven. I see if I can work out what is happening.

I'm hitting this very same issue. Works fine from IntelliJ but not through maven. It mentions "org.reflections.Reflections - Reflections took 6 ms to scan 1 urls, producing 0 keys and 0 values"
which seems wrong...

I think I found the issue. The failsafe runner was trying to run my producer tests, and since it at that point does not know about pact, it fails.
To work around it, I added my producer tests as excluded by failsafe, and I added the "pact-jvm-provider-maven" plugin to the "verify" lifecycle phase.
Now, failsafe will first run my consumer tests and then afterwards the "pact:verify" target will run to verify the producer.
Since I'm doing a proof-of-concept I have both producer and consumer in the same repo which creates this messy situation.
So for anyone running into this problem with producer tests, see if it's actually surefire (or similar) picking up and trying to run the tests, instead of the pact-maven plugin.

Any update on this issue. I'm facing the same issue.

@RaghuJ check that you are not running the verification as a test. It should be run by the pact-maven plugin and not a unit test.

@uglyog Thanks :) I was able to run it.

I was able to run the test with the failsafe maven plugin, by adding the following config to the plugin:
 <configuration>
      <useManifestOnlyJar>false</useManifestOnlyJar>
</configuration>

The test failed when being run with the failsafe  (or surefire) maven plugins, because the  SystemClassLoader returned only the failsafe/surefire booter.jar, when the classpath urls were being retrieved from it (check code in AmqpTarget.java ).
With the configuration in place, the full classpath is being listed through the SystemClassLoader, and therefore the @PactVerifyProvider annotations are correctly identified.
For more plugin configuration details, check  Failsafe Class Loading


Pull Request for PVsyst_parameter_estimation

This is the pull request for https://github.com/pvlib/pvlib-python/issues/227. Since the issue was opened, I have finished the singlediode port with accompanying tests and the Schumaker_QSpline port. I still need to write some tests to make sure that Schumaker_QSpline is fully functional; so far I have only tested it with out nose by using the python command console. Once the tests for Schumaker_QSpline are finished, I'll begin porting est_single_diode_param and write some tests for that code and then finish up with the PVsyst_parameter_estimation port with some accompanying tests. With that said, I wanted to start this pull request since this is such a large merge and wanted to start the feedback / discussion process.

Thanks @mattguttenberg! This looks great. I really appreciate that you wrote tests, too. Let's first address a few bigger and more general things. After that, I'll go through the code more carefully and make some line by line comments.
style: please install flake8 and pep8-naming and run them against all of your new code. This way I don't have to comment on every little style issue. Also run them against some of the existing modules so that you can get a feel for what to ignore. The big things that I see right now are line length and capitalization.
module structure: pvlib python prefers to consolidate similar functions into modules. We'll also want to make some (all?) of the helper functions into private methods. This is so that they don't become automatically documented by sphinx, and so that people don't rely on them for their own code.
lambertw: Is there a reason that you implemented lambertw instead of using the scipy lambertw? See e.g. pvsystem.v_from_i for an example of its usage in pvlib.
schumaker_qspline: I'm not familiar with this algorithm, but I'm wondering if scipy and/or statsmodels already has it (maybe under a different name or with the right parameters).
plotting: I'd like to see a better separation between plotting code and the rest of the code. Move the plotting stuff into a separate functions. You should also import matplotlib within those functions rather than at the top of the module. This way we don't need to make matplotlib a required dependency.
tests: put the calculations inside the test functions. numpy now recommends using assert_allclose instead of assert_array_almost_equal
documentation: Compare your documentation syntax to the numpydoc standard and/or the rest of pvlib.

Ø  schumaker_qspline: I'm not familiar with this algorithm, but I'm wondering if scipy and/or statsmodels already has it (maybe under a different name or with the right parameters).
I very much doubt it.  The algorithm produces a quadratic spline that preserves both monotonicity and concavity.  I didn’t find any code when I looked 2 years ago.  There’s a nascent R package now which might give us some ideas about making my matlab code more general and perhaps become a submission to a python package.
Cliff
From: Will Holmgren<EMAIL_ADDRESS>Sent: Wednesday, August 17, 2016 11:54 AM
To: pvlib/pvlib-python<EMAIL_ADDRESS>Subject: [EXTERNAL] Re: [pvlib/pvlib-python] Pull Request for PVsyst_parameter_estimation (#229)
Thanks @mattguttenberghttps://github.com/mattguttenberg! This looks great. I really appreciate that you wrote tests, too. Let's first address a few bigger and more general things. After that, I'll go through the code more carefully and make some line by line comments.
style: please install flake8http://flake8.pycqa.org/en/latest/ and pep8-naminghttps://pypi.python.org/pypi/pep8-naming and run them against all of your new code. This way I don't have to comment on every little style issue. Also run them against some of the existing modules so that you can get a feel for what to ignore. The big things that I see right now are line length and capitalization.
module structure: pvlib python prefers to consolidate similar functions into modules. We'll also want to make some (all?) of the helper functions into private methods. This is so that they don't become automatically documented by sphinx, and so that people don't rely on them for their own code.
lambertw: Is there a reason that you implemented lambertw instead of using the scipy lambertw? See e.g. pvsystem.v_from_i for an example of its usage in pvlib.
schumaker_qspline: I'm not familiar with this algorithm, but I'm wondering if scipy and/or statsmodels already has it (maybe under a different name or with the right parameters).
plotting: I'd like to see a better separation between plotting code and the rest of the code. Move the plotting stuff into a separate functions. You should also import matplotlib within those functions rather than at the top of the module. This way we don't need to make matplotlib a required dependency.
tests: put the calculations inside the test functions. numpy now recommends using assert_allclose instead of assert_array_almost_equalhttp://docs.scipy.org/doc/numpy/reference/generated/numpy.testing.assert_array_almost_equal.html
documentation: Compare your documentation syntax to the numpydoc standard and/or the rest of pvlib.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/pvlib/pvlib-python/pull/229#issuecomment-240492679, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFJNL8LT3a6fq2e3PrmYzmOzjhvGkAIzks5qg0rMgaJpZM4JcNwM.

@wholmgren Thank you for all of the great feedback. I did notice that lambertw was already added to scipy and had made use of it in most of the scripts I had wrote. When I was running tests for calc_theta_phi_exact, however, I found that in some of the test cases I written, an edge case was observed were lambertw from scipy returned infinity while the lambertw script produced a very large value but not infinity which lead to an assertion error. Thus I had chosen to keep the function in on this port instead of 100% switching to the scipy version of the function to try and minimize discrepancy between the MATLAB version and ported version I had wrote.

Can you use pvsystem.v_from_i instead?

I thought I removed the v_from_i script I wrote and changed to using the pvsystem function in one of my latest commits.

After double checking with my latest commit, I had already removed the v_from_i script I had written after I realized that pvsystem already had it and changed the scripts to use the one that already existed

It seemed to me that you could avoid the whole lambertw issue if you relied on pvsystem.v_from_i (which already handles overflow internally). Maybe I didn't read carefully enough, though.

Oh I see. The error occurred in calc_theta_phi_exact. v_from_i could be used to calculated phi from the looks of it since they share the same argw formula but the formula for theta would still need the script as its argw formula is different from that of v_from_i and if I remember correctly, it was the theta term that was throwing the error mentioned above.

Could we add similar code to pvsystem.i_from_v? If so, we might want to move the log solver into its own function that lives in, say, tools.py. Could be something like...
# in tools.py
def lambertw_maybe_log(argW, logargW):
    # scipy's result
    lambertwterm = lambertw(argW).real

    # Three iterations of Newton-Raphson method to solve
    # w+log(w)=logargW. The initial guess is w=logargW. Where direct
    # evaluation (above) results in NaN from overflow, 3 iterations
    # of Newton's method gives approximately 8 digits of precision.
    w = logargW
    for i in range(0, 3):
        w = w * (1 - np.log(w) + logargW) / (1 + w)
    lambertwterm_log = w

    lambertwterm = np.where(np.isfinite(lambertwterm), lambertwterm,
                            lambertwterm_log)

    return lambertwterm

def v_from_i(...):
    # ...
    argW = I0 * Rsh / nNsVth * np.exp(Rsh * (-I + IL + I0) / nNsVth)

    # Calculate using log(argW) in case argW is really big
    logargW = (np.log(I0) + np.log(Rsh) - np.log(nNsVth) +
               Rsh * (-I + IL + I0) / nNsVth)

    lambertwterm = tools.lambertw_maybe_log(argW, logargW)
    # ...

def i_from_v(...):
    # ...
    argW = (Rs*I0*Rsh *
            np.exp(Rsh*(Rs*(IL+I0)+V) / (nNsVth*(Rs+Rsh))) /
            (nNsVth*(Rs + Rsh)))

    logargW = np.log(...) + np.log(...) + ...

    lambertwterm = tools.lambertw_maybe_log(argW, logargW)
    # ...

Here's the IV curve data we provide with PVLib matlab, in csv format.  Also, python code to read the data into a dict with the structure currently used by the parameter estimation code.
PVsyst_demo.txt
import numpy as np
specs = {key: None for key in ['ns', 'aisc','bvoc','type']}
keylist  = ['isc', 'imp', 'vmp', 'voc', 'poa', 'tc', 'ee']
ivcurves = {key: None for key in keylist}
with open('PVsyst_demo.txt', 'r') as f:
Ns, aIsc, bVoc, descr = f.readline().split(',')

specs['ns'] = int(float(Ns))
specs['aisc'] = float(aIsc)
specs['bvoc'] = float(bVoc)
specs['type'] = descr

strN, strM = f.readline().split(',')
N = int(strN)
M = int(strM)

isc = np.empty(N)
imp = np.empty_like(isc)
vmp = np.empty_like(isc)
voc = np.empty_like(isc)
ee = np.empty_like(isc)
poa = np.empty_like(isc)
tc = np.empty_like(isc)
v = np.empty((N, M))
i = np.empty_like(v)

for k in range(0,N):
    isc[k], imp[k], vmp[k], voc[k], poa[k], tc[k], ee[k] = f.readline().split(',')
    tmp = [str.strip(',') for str in f.readline().split()]
    while len(tmp)<M:
        tmp.append('NaN')
    v[k,] = [float(x) for x in tmp]
    tmp = [str.strip(',') for str in f.readline().split()]
    while len(tmp)<M:
        tmp.append('NaN')
    i[k,] = [float(x) for x in tmp]

ivcurves.append(ivcurve)
ivcurves['v'] = v
ivcurves['i'] = i

Here's the solution for pvsyst from Matlab, and python code to read the csv file into an OrderedDict.
PVsyst_demo_model.txt
import numpy as np
from collections import OrderedDict
specs = {key: None for key in ['ns', 'aisc','bvoc','type']}
paramlist  = ['IL_ref', 'Io_ref', 'eG', 'Rsh_ref', 'Rsh0', 'Rshexp', 'Rs_ref', 'gamma_ref', 'mugamma']
varlist = ['Iph', 'Io', 'Rsh', 'Rs', 'u']
pvsyst = OrderedDict(key = paramlist + varlist)
with open('PVsyst_demo_model.txt', 'r') as f:
Ns, aIsc, bVoc, descr = f.readline().split(',')

specs['ns'] = int(float(Ns))
specs['aisc'] = float(aIsc)
specs['bvoc'] = float(bVoc)
specs['type'] = descr

IL_ref, Io_ref, eG, Rsh_ref, Rsh0, Rshexp, Rs_ref, gamma_ref, mugamma = f.readline().split(',')
for key in paramlist:
    pvsyst[key] = float(eval(key))

strN = f.readline()
N = int(strN)

Iph = np.empty(N)
Io = np.empty_like(Iph)
Rsh = np.empty_like(Iph)
Rs = np.empty_like(Iph)
u = np.empty_like(Iph)

for k in range(0,N):
    Iph[k], Io[k], Rsh[k], Rs[k], u[k] = f.readline().split(',')

for var in varlist:
pvsyst[var] = eval(var)

@mattguttenberg @cwhanse any plans for finishing this PR? Maybe someone else wants to pick it up? I don't personally have a need for this feature or the time to do it.

I will try to pick this up and fix it soon, maybe by the end of the year?

continuing this in a new branch, also PV_LIB MATLAB works fine in Octave on Linux.

@wholmgren  and @cwhanse do you want to close this in favor of #708

I've squashed all of these commits into c00d4191f2f1cb6f2536402e1fbdc0850aeae08e and rebased them on v0.4 then rebased that on master, to preserve the history
then isolated them in a new temporary folder until we decide what to do with them
then got them working in name only, there are some tests, all tests pass, but I think the testing is still insufficient


feat:  Replaced dropdown with toc component

Replaced dropdown with toc component to remove graphical glitches, improve usability and render sub headings.

Hey @cpreston321 @pi0 anything that's blocking this from being merged? I think it's a very low hanging fruit for improving the UI in the docs ecosystem :)

Sorry for late response @itpropro.
Actually it is part of new design that (similar to vue, vite docs) we have a compact and minimal TOC dropdown instead of sidebar.
One other reason was that we usually don't have a lot of headings (in current unjs project docs) and it was wasting sidebar.
How do you think? Maybe we can use a responsive method to only show it on larger screens?

b3e97699f07c30ecf74d1c20e49f2b10c268d625 add sidebar TOC it in large screens


feature request: table

Bug, feature request, or proposal:
feature request
What is the expected behavior?
dragble column header, row group, row selectable
What is the current behavior?
none
What are the steps to reproduce?
Providing a Plunker (or similar) is the best way to get the team to see your issue.
Plunker template: https://goo.gl/DlHd6U
What is the use-case or motivation for changing an existing behavior?
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
Is there anything else we should know?

It's there dude in latest release

Inappropriate issue title. Feature request is about extending tables with some behavior.
However i can't understand even details - too small description of desired features.

@andrewseguin These features also highly demanded. Please consider these features on next release if possible . Thanks
For example
   <md-table #table [dataSource]="dataSource"
                     mdSort
                     mdFixHeader="true"     // header will be fixed on vertical scroll
                     mdFixFooter="true"     // footer will be fixed on vertical scroll
                     mdFixLeftCol="3"       // fix  columns on left side while horizontal scroll
                     mdFixRightCol="3"      // fix columns on right side while horizontal scroll
                     mdCellEditable="true"> // adds an inline editable input on cell clicks

@irowbin i mean the column header can be draged from one position to another position.
rowgroup: like treegrid in easyui.
row selectable: means the row can be selected ,i can get the value the row i selected and with the selected css style

We have no plans to bake drag-and-drop into the table itself, though we will be exploring general drag/drop utilities that could be applied to the table in the future.


Java generation: make fields in XSettings classes final

Done in https://github.com/googleapis/toolkit/commit/cc664d4b48f44e4652099d5809764b2e157d827d .


addMarker with visible false not working in iOS

map.addMarker({
                'position': position,
                'visible': false,
              });

this doesn't work in iOS. works in Android

I guess you use the npm version which is released 6 month ago.
Please use the master branch version instead.
(Next version is still under construction, sorry)

using master branch

+1
Using master branch, i got the same issue (only in iOS)
It was working with the npm version

Use the plugin v2-beta version, plrase.

@wf9a5m75 which branch world that be?  Can't see no v2-beta


[5.4] Fix eloquent get dirty with casted attributes

Equivalent values were being considered as different in getDirty method.
This happens when the attributes are casted.
$model = new Model;
$model->boolAttribute = 1;
$model->syncOriginal();
$model->boolAttribute = $model->boolAttribute;

// Fail because true !== 1
$this->assertFalse($model->isDirty('boolAttribute'));

I really don't want to complicate this logic anymore. Sorry.


Offer settings to minimalise options in interface

Personally, I like all the feature but some elderly friends of mine and friends with concentration challenges find the interface offering too many options and are visually overloaded. This distracts them and they have a hard time using this otherwise very good app.
Please consider adding the following options which are off by default and are called:

Show check list
Show dates (and times)
Show detailed progress
Show privacy

For each item, I would like to provide a rational that also applies to normal users.

The "Show check list" will show checklist related controls and info. Not many people use this, so it might be hidden as default, making the app more lighter in use and not bother people with these options if they do not use them. This should also hide/show Tasks due tab.

The "Show dates and times" or shorter "Show dates" will show all date and time related controls and info for start, end and due date and all day and time zone. I know this is supported in VTODO, but some people should be encouraged to use their calendar for date and time related events so it is stored in a VEVENT. See also https://en.wikipedia.org/wiki/Getting_Things_Done (What could be offered is a feature to convert a task into a calendar appointment by adding date and time and delete it as a task. Thunderbird offers this for example. For that another feature request should be created.) Hiding and showing thesecontrls and info shoudl also be reflected in the Tasks due and Tasks starting tab.

The "Show detailed progress" or "Show progress details" shows completed date time and percent completed as is now. But when switched off, only shows if a task is completed or not. Simple and what most users probably need.  Hiding and showing these contrls and info should also be reflected in the Tasks progress tab.

On "Show privacy"; privacy is usually covered by the url and credentials of the calendar service being used. Controls and info for this can be hidden by default as well as not many users use this and is only confusing to novice users.

Implementing these features will greatly simplify and improve the user experience for those who do never use certain aspects and/or are easily distracted with too many functions.

+1


Clarify callout options and update to markdown from Liquid

Why:
In order to better align to the style guide and improve consistency in syntax.

What's being changed (if available, include any code snippets, screenshots, or gifs):

Updated the Basic writing and formatting syntax file to have the callouts be in markdown syntax instead of Liquid syntax.
Updated the "Alerts" section of the same file to "Callouts" to align on the naming convention used in the style guide.
Updated the Style guide file to include Important as a callout option as described in the Basic writing and formatting syntax file

Check off the following:

[x] I have reviewed my changes in staging, available via the View deployment link in this PR's timeline (this link will be available after opening the PR).

For content changes, you will also see an automatically generated comment with links directly to pages you've modified. The comment won't appear if your PR only edits files in the data directory.

[x] For content changes, I have completed the self-review checklist.

@emangulo Thanks so much for opening a PR! I'll get this triaged for review ✨

@emangulo - many thanks for flagging this discrepancy between the description of how to use Notes etc. in GitHub generally, and on the style guide for contributors to the user documentation for GitHub. I think you're right that we should use the same term for both.
I'm going to check in with our content strategy team on whether we should use the term "alerts" or "callouts" for both before I review this PR.

Hi @ethanpalm,
I have included your suggestions and also changed any additional references to callouts in the Alerts section of the style guide. Also removed the Important examples.
I have also updated this Callout tags section to Alerts


az aks install-cli "certificate verify failed"

Not sure if this is the right place for this but I'm trying to install the Kubernetes cli tools in the Azure portal cloud-cli and am getting a certificate verify failed error
`PS Azure:> az aks install-cli
<urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)>
Traceback (most recent call last):
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\http\client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\http\client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\http\client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\http\client.py", line 1026, in _send_output
self.send(msg)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\http\client.py", line 964, in send
self.connect()
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\http\client.py", line 1400, in connect
server_hostname=server_hostname)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\ssl.py", line 401, in wrap_socket
_context=self, _session=session)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\ssl.py", line 808, in init
self.do_handshake()
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\ssl.py", line 1061, in do_handshake
self._sslobj.do_handshake()
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\ssl.py", line 683, in do_handshake
self._sslobj.do_handshake()
ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\azure\cli\main.py", line 36, in main
cmd_result = APPLICATION.execute(args)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\azure\cli\core\application.py", line 216, in execute
result = expanded_arg.func(params)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\azure\cli\core\commands_init_.py", line 381, in call
return self.handler(*args, **kwargs)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\azure\cli\core\commands_init_.py", line 630, in execute_command
reraise(*sys.exc_info())
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\six.py", line 693, in reraise
raise value
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\azure\cli\core\commands_init.py", line 612, in _execute_command
result = op(client, **kwargs) if client else op(**kwargs)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\azure\cli\command_modules\acs\custom.py", line 286, in k8s_install_cli
context=context).read()
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 526, in open
response = self._open(req, data)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 544, in _open
'_open', req)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
File "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\urllib\request.py", line 1320, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)>
Azure:`

This is still an issue with az 2.0.27.

Interestingly, using PowerShell's curl cmdlet and invoking python's urllib directly don't show this bug. So it may be specific to the packaging of az for Windows Cloud Shell.

python -c "import urllib; print urllib.urlopen('https://storage.googleapis.com/kubernetes-release/release/v1.9.2/bin/windows/amd64/kubectl.exe').read()"
curl https://storage.googleapis.com/kubernetes-release/release/v1.9.2/bin/windows/amd64/kubectl.exe -UseBasicParsing

Also verified that this bug doesn't occur when using az 2.0.27 installed from the .MSI package on Windows 10. Just Cloud Shell / PS as far as I can tell.

Same error here when using powershell. Doesn't occur with bash shell but I'm getting this error with bash:
Connection error while attempting to download client ([Errno 13] Permission denied: '/usr/local/bin/kubectl')
Maybe this is not related to this issue.

@marvinpuethe that's a different error actually. You got past the SSL: CERTIFICATE_VERIFY_FAILED error but ran into a filesystem permissions problem.
It's difficult to know much about users, groups, filesystem permissions and the search PATH on either Windows or Linux, so az takes a hands-off approach by trying to write to the common /usr/local/bin location. In this case, your user didn't have permissions to write there, which isn't uncommon.
As a workaround, either run the command with sudo to give yourself the necessary permissions, or download the file to a writeable location and then move it into your search PATH:
sudo az aks install-cli  # or
az aks install-cli --install-location=./kubectl && sudo mv kubectl /usr/local/bin/kubectl

I got another report that az aks install-connector is failing with Error: failed to download on Cloud Shell / PS. The tarball it's failing to fetch is accessible, so my guess is it's another instance of this packaging problem.

On windows, set SSL version to TLSv1 to solve the issue:
python -c "import ssl; import urllib; context = ssl.SSLContext(ssl.PROTOCOL_TLSv1); urllib.urlopen('https://storage.googleapis.com/kubernetes-release/release/v1.9.1/bin/linux/amd64/kubectl', context=context)"

Facing the same issue on Mac when running az aks install-cli, using v2.0.38

Just like 'miaojiang' wrote I am too .. "Facing the same issue on Mac when running az aks install-cli, using v2.0.38"

https://stackoverflow.com/questions/41691327/ssl-sslerror-ssl-certificate-verify-failed-certificate-verify-failed-ssl-c

I'm seeing this on Mac as well using
azure-cli                         2.0.58
Ironically I was trying to go through the Azure Kubernetes workshop...  Please advise.  Also Please do not close issues if there are not actually fixed!!  Thank you.


List my own components

In addition to the components generated by other community members it would be nice to have a list of my own components (like on my profile page: https://www.vue0.dev/anbraten).

Hey @anbraten ! I just push this feature hahahaha! You can check the link above or https://www.vue0.dev/zernonia

Pretty nice already. Maybe that page can be linked in the user menu when clicking on the avatar. In addition it maybe could be part of the dashboard. Something like a tab-switch Community generated and Generated by you:

Good idea 👍🏻


Error: "The key __typename was not found" when using DataStore with existing data in database.

Describe the bug
If the api is created without enabling conflict detection and data is saved to the backend using the API plugin then after conflict detection is added DataStore fails with The key __typename was not found
To Reproduce
Steps to reproduce the behavior:

Create new api as described in the tutorials using amplify cli - amplify api add without enabling conflict detection under the advanced settings option
push changes amplify push
Save data to the backend using Amplify.API.mutate function
Use the Amplify CLI to edit the conflict detection settings. amplify update api
push changes amplify push
Use the Amplify.DataStore api to fetch data. Amplify.DataStore.query
Error is shown in console and data is not synced from backend:

APIError: failed to process graphqlResponseData
Caused by:
DataStoreError: The key `__typename` was not found
Recovery suggestion: Check if the parsed JSON contains the expected `__typename`

Expected behavior
The data to sync from the backend
Environment(please complete the following information):

Amplify Framework Version: 1.0
Dependency Manager: Cocoapods
Swift Version : 5.1

Device Information (please complete the following information):

Device: Simulator
iOS Version:  iOS 13

+1

@spenceps @amuresia @jfcadillo951 does any of you remember and can provide details on how you inserted the data previously in the DataBase?
Was it using the AppSyncClient SDK? Or using Amplify Console? Or using the DynamoDB UI?

@drochetti - I was using the AppSyncClient SDK. i.e. Amplify.API.mutate()

@drochetti for me it was via the Amplify Console and via the mobile DataStore library.

@drochetti - I was using the AppSyncClient SDK. i.e. Amplify.API.mutate()

Amplify.API.mutate is not AppSyncClient SDK, it's Amplify.
Did you created all the data previously in the DataBase using Amplify and ended up with data without __typename?

@drochetti - I did create all the data with Amplify. I don't remember if __typename was in the DynamoDB and I have since deleted the data.

+1, Also experiencing this issue.

I ran into this as well.
Seems like when conflict resolution is not turned on, the associated dynamo table has the following fields:

id
__typename
createdAt
updatedAt
Any other custom fields that the model might have

Once conflict resolution is turned on, (and making a mutation), two additional fields show up for each entry of the model:

_lastChangedAt
_version

I guess the use case would be if someone was using Amplify.API with GraphQL w/out conflict resolution turned on.. then made a bunch of mutations, and then decided, that they wanted to move to using Amplify.Datastore.
To work around this, I would imagine that after you've turned on conflict resolution, you could backfill the data so that all entries have a _lastChangedAt and _version field.  I haven't tried it-- but I imagine it would work.  (Don't do this!!!!) Another option would be to remove all the items from the dynamo db table and then turn on conflict resolution, but, again, probably not a good idea unless you want to delete all the entries in your dynamo table.
Just curious: Is there anyone on this thread has any use case with regards to toggling conflict resolution on and off, or did we run into this bug because we were exploring the differences between API and Datastore?

Opened up an issue against CLI: https://github.com/aws-amplify/amplify-cli/issues/4690 to support customers who are using API (GraphQL) and moving to Datastore

CLI gh issue was closed because this needs more details design and require investigating all the use cases and side effects. I will keep this ticket open and will update here when we have more info.

i've been using admin UI and have the same issue
is there any workaround on this ?

Hi @brightfuture, could you expand on the steps that you took through the Admin UI to get into the same state? My understanding of the problem is

Make API calls using Amplify.API without conflict resolution
Enable conflict resolution on the API
Add DataStore to the app, then the data without conflict resolution fields will fail to sync from the cloud

I thought Admin UI gets you to persist directly to DataStore right from the beginning. Feel free to open another issue if you have more details and it does not sound like this is the same issue. The current workaround as @wooj2  mentioned, the data needs to be fixed or deleted. If you are in development, I would suggest removing the items from the DynamoDB table, then no data will be synced from the cloud, and as you write data using Amplify.DataStore, it will automatically sync to the cloud.

@lawmicha i can't recall clearly what happened
i couldn't find a fix so i deleted the project and created a new one
so i can't recreate the problem
i think it was because i made changes to DynamoDB from Python Lambda function
and that function didn't seem to be compatible with how Amplify mutates data in DynamoDB
thus cause incompatibility

made changes to DynamoDB from Python Lambda function

That would definitely cause issues. By default, direct updates to the backing DDB tables would not trigger any subscriptions, since AppSync isn't aware that the data has been modified. Secondly, mutations have particular constructions including version control and conflict resolution fields that have to be kept in sync. Thirdly, if you do have DataStore syncing enabled, updates posted directly to DDB would bypass the sync tables that we use to keep track of updates to a record, meaning that even if you do store the value in the DDB table correctly, you wouldn't necessarily see it in your application if it does a "sync" query--only a full query would return the posted value.
The recommendation for DDB tables backing DataStore applications is to always post mutations via DataStore, or via well-structured queries through the AppSync GraphQL endpoint.

@palpatim thanks for the explaination!
it looks like performing backend logic with anything other than NodeJS is fairly difficult atm
i really wish this could be improved soon
currently Amplify is too much frontend centered, i can hardly do anything automatically on the backend

@brightfuture It would be great to start a discussion about this so we can dig into the use cases you're trying to accomplish. From there, we can think how we might be able to either enable them with framework or CLI features, or at least provide better guidance to folks like you who want to support backend workloads that leverage the persisted models.

It's been a while since this issue has received some activity but I just got the same error. Resolved by deleting the data in my backend and attempting the query again. This may be ideal for development, but not for production.

Same issue for , I just updated the schema and this start happening

same error after add a many to many link.

Just received for the first time, made no changes to schema. Only removed delete feature from user

I'm also experiencing this issue after updating my schema. Has any progress been made on this?

Error:
DataStoreError: The key __typename was not found
General root cause:
There is an inconsistency with database/tables/items/entry value. This means that you have an entry that does not match your defined schema structure, or the database on the cloud is in contradict with the database on the device.
Solution:
You need to find that particular non-conforming table, or item, or entry value and amend/delete that from database on the cloud. Restart, and you are good to go.


feat: #15 docs are complete

feat: #15 docs are complete

:tada: This PR is included in version 1.0.3 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[todo] Support Tabs/Processes

I like that Surf is stateful. Actionable methods like Open() and Post() modify the state of the browser rather than returning some object representing the request. However I've run into some minor problems with this stateful approach. I would like to add support for tabs/processes so developers can configure the browser once, and then create any number of tabs/processes that do the actual work.
How a page is opened now:
bow := surf.NewBrowser()
err := bow.Open("http://golang.org")
if err != nil {
	panic(err)
}

How it would be opened with "tab" support.
// Create and configure a new browser.
bow := surf.NewBrowser()
bow.AddRequestHeader("User-Agent", "Surfbot 1.0")
bow.SetTransport(&http.Transport{})

// Create a new tab. The tab is essentially an instance
// of Browsable, and inherits it's configuration from
// the parent browser.
tab := bow.NewTab()
err := tab.Open("http://golang.org")
if err != nil {
	panic(err)
}

Still debating using the term "tab", which may be taking the browser terminology too far, but on the upside the concept behind a tab -- and how it works -- should be easily understood by developers.
The feature may be treading into "over engineered" territory. Will have to give it some thought.

It would be great if each tab, can be add your own transport (a proxy, for example). And the function of closing (cleaned) tab.


[HUDI-836] Add configs for Datadog metrics reporter

Update configuration docs for https://github.com/apache/incubator-hudi/pull/1572
Committer checklist

[ ] Has a corresponding JIRA in PR title & commit

[ ] Commit message is descriptive of the change

[ ] CI is green

[ ] Necessary doc changes done or have another open PR

[ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

@yanghua : Assigning to you as you are reviewing the corresponding metrics implementation.

Note: blocked by #1572

@yanghua Not sure if the merging is blocked by generating 0.5.3 docs as this is for 0.6.0 docs.

@xushiyan Since the reporter has been merged, I will review this PR soon.


tests/subsys/settings/fcb: add check for target compatibility

Added tests of flash driver compatibility with fcb-backend.
For flash drivers which support write-block-size bigger than 1 B
test of unaligned data access uses native write-block-size
as it is dedicated to check whether settings works well on platform
which has 1 B access which is native on the current DUT.
Signed-off-by: Andrzej Puzdrowski<EMAIL_ADDRESS>

Codecov Report

Merging #14040 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master   #14040   +/-   ##
=======================================
  Coverage   52.24%   52.24%
=======================================
  Files         307      307
  Lines       45467    45467
  Branches    10525    10525
=======================================
  Hits        23752    23752
  Misses      16913    16913
  Partials     4802     4802

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0ef2408...974c5de. Read the comment docs.

@erwango - updated

Rerunning CI as it's been a while since this PR was updated


Support ARC cluster types for workload identity

Reason for Change:

This is the PR for supporting Workload identity in ARC cluster types. In ARC cluster types we are expecting the identity from a separate identity provider which are creating and maintaining secrets.  The mutating web-hook is expected to mount a secret in this case.

Requirements

[x] squashed commits
[ ] included documentation
[x] added unit tests and e2e tests (if applicable).

Issue Fixed:

Please answer the following questions with yes/no:
Does this change contain code from or inspired by another project? If so, did you notify the maintainers and provide attribution?

[ ] yes
[x] no

Notes for Reviewers:

Codecov Report

Merging #918 (13fb315) into main (ba4a63e) will increase coverage by 2.34%.
The diff coverage is 68.62%.

@@            Coverage Diff             @@
##             main     #918      +/-   ##
==========================================
+ Coverage   51.76%   54.10%   +2.34%
==========================================
  Files          36       36
  Lines        2376     2336      -40
==========================================
+ Hits         1230     1264      +34
+ Misses       1100     1023      -77
- Partials       46       49       +3

Impacted Files
Coverage Δ

pkg/webhook/webhook.go
78.59% <68.62%> (-0.70%)
:arrow_down:

... and 5 files with indirect coverage changes

Closing this PR as it's inactive and there are ongoing internal discussions.


Esm

Codecov Report

Merging #80 (373d5d3) into main (041668d) will decrease coverage by 3.03%.
The diff coverage is 74.24%.

@@            Coverage Diff             @@
##             main      #80      +/-   ##
==========================================
- Coverage   79.32%   76.28%   -3.04%
==========================================
  Files           4       10       +6
  Lines         266      253      -13
==========================================
- Hits          211      193      -18
- Misses         55       60       +5

Impacted Files
Coverage Δ

lib/cli.js
0.00% <0.00%> (ø)

lib/config.js
100.00% <ø> (ø)

lib/test.config.js
100.00% <ø> (ø)

lib/authn.js
68.75% <68.75%> (ø)

lib/main.js
77.10% <77.10%> (ø)

lib/urls.js
77.77% <77.77%> (ø)

lib/helpers.js
91.80% <91.80%> (ø)

lib/exceptions.js
100.00% <100.00%> (ø)

lib/index.js
100.00% <100.00%> (+22.72%)
:arrow_up:

lib/logger.js
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 041668d...373d5d3. Read the comment docs.


t5 model ,the inference result are wrong when the batch size > 1

System Info
A100  Tensorrt_llm 0.7.0
Who can help?
@byshiue @sy
Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[ ] My own task or dataset (give details below)

Reproduction

Converted the T5-large model according to the official example, using GPT and BERT plugins with float16 precision. Inference works correctly when batch size is 1.

When batch size > 1, e.g., batch size = 4, we observed that the self-attention results are correct for odd batch indices, but the output of self-attention is all zeros for even batch indices.

We debugged the decoder separately (using the T5 encoder output from HF as the input for the decoder) and found that self-attention in the decoder works correctly. However, in the cross-attention, the results are correct for odd batch indices, but the output is all zeros for even batch indices.

The above phenomenon only occurs when using the BERT and GPT plugins; it does not occur in plain TensorRT mode.
Expected behavior
When the batch size is greater than 1, using the BERT and GPT plugins in the T5 model shows significant abnormalities, where certain dimensions of the attention output are entirely zeros.
actual behavior
When the batch size is greater than 1, using the BERT and GPT plugins in the T5 model shows significant abnormalities, where certain dimensions of the attention output are entirely zeros.
additional notes
When the batch size is greater than 1, inference in the T5 family models behaves abnormally.

It seems that you're using a very outdated version (0.7.0), could u please try the latest main branch code?

@nv-guomingz Yes, due to historical reasons, we developed on version 0.7.0. We have not seen anyone else report this issue in the issues section. We hope to address this problem in version 0.7.0. Have you ever encountered a similar issue?

@nv-guomingz Yes, due to historical reasons, we developed on version 0.7.0. We have not seen anyone report this issue in the issues section, and it is possible that this problem still exists in the newer versions. Therefore, we hope to address this problem in version 0.7.0. Have you ever encountered a similar issue?

For me, I can't recall there's such issue for bert on 0.7.0 version.
Would u please provide us step-by-step instructions for reproducing such issue?
I still suggest you try the latest release whl instead of using 0.7.0 to see if the issue still exists or not.
If so, we'll file a bug for internal tracking and  investigating.

@nv-guomingz Just now, we used TensorRT LLM version 0.90 and converted T5-large using the official example (example/enc_dec/).
First, we followed the official example to convert the weights to float16.
Then, we used build.py to build the engine with batch_size=4, using the GPT plugin and the BERT plugin, with float16 precision, keeping everything else consistent with the official example.
We used run.py for inference. The inference results are abnormal in the even batch dimensions and correct in the odd batch dimensions. We have identified that the issue lies with the self-attention output in the BERT plugin being abnormal. In the GPT plugin, the self-attention output is normal, but the cross-attention output is abnormal, with the values in the even batch dimensions being all zeros. This might be a bug in the plugin.

Could you try the latest version TRT_LLM 0.11+
see the tutorial: https://nvidia.github.io/TensorRT-LLM/installation/linux.html

i have the same issuse when use gpt_attention plugin
6 A10
2tp 3pp

tenosrrt-llm 0.10.0

Hi @0xd8b @1096125073 , can you please provide your trt-llm version, runtime type (python or pybind of C++), model name, reproducible input examples (English preferred)? Because on our end we wasn't seeing any issue with BS>1
Examples:
0.10.0, pybind of C++, google/t5-large, ["xxx", "yyy", "zzz"]

Sure, Due to time constraints, I did not provide detailed information earlier. here is the translated information:

First, we fine-tuned the t5-large network without changing the decoder's architecture.

We used float32 precision during training and float16 precision during engine conversion.

The engine conversion configurations are as follows:
tensorrt_llm versions: 0.7.0 and 0.9.0

--world_size=1
--tp_size=1
--pp_size=1
--gpus_per_node=8
--parallel_build=False
--weight_from_pytorch_ckpt=False
--engine_name="t5-small"
--debug_mode=False
--timing_cache="model.cache"
--model_type="t5"
--dtype="float16"
--logits_dtype="float16"
--log_level="info"
--max_batch_size=4
--max_encoder_input_len=1500
--max_decoder_input_len=1
--max_output_len=200
--max_beam_width=1
--use_bert_attention_plugin="float16"
--use_gpt_attention_plugin="float16"
--use_gemm_plugin="float16"
--use_layernorm_plugin=False
--use_rmsnorm_plugin=False
--use_lookup_plugin=False
--enable_qk_half_accum=False
--builder_opt=None
--remove_input_padding=False
--random_seed=None
--use_parallel_embedding=False
--embedding_sharding_dim=0
--use_custom_all_reduce=False
--strongly_typed=True
--gather_all_token_logits=False

We constructed an encoder_output with the shape [1, 545, 1024], using float16, and repeated it four times along the batch dimension, resulting in an encoder_output with the shape [4, 545, 1024] as input for the decoder. The final decoder output predictions for batch=0 and batch=2 were the same, and batch=1 and batch=3 were the same. As mentioned above, the attention layer output is all zeros in even dimensions. Additionally, we modified the C++ code mentioned here in versions 0.7.0 and 0.9.0: https://github.com/NVIDIA/TensorRT-LLM/issues/1343.

sorry,  I did not provide detailed information earlier. here is the related information:

First, we fine-tuned the t5-large network without changing the decoder's architecture.

We used float32 precision during training and float16 precision during engine conversion.

The engine conversion configurations are as follows:
tensorrt_llm versions: 0.7.0 and 0.9.0

--world_size=1
--tp_size=1
--pp_size=1
--gpus_per_node=8
--parallel_build=False
--weight_from_pytorch_ckpt=False
--engine_name="t5-small"
--debug_mode=False
--timing_cache="model.cache"
--model_type="t5"
--dtype="float16"
--logits_dtype="float16"
--log_level="info"
--max_batch_size=4
--max_encoder_input_len=1500
--max_decoder_input_len=1
--max_output_len=200
--max_beam_width=1
--use_bert_attention_plugin="float16"
--use_gpt_attention_plugin="float16"
--use_gemm_plugin="float16"
--use_layernorm_plugin=False
--use_rmsnorm_plugin=False
--use_lookup_plugin=False
--enable_qk_half_accum=False
--builder_opt=None
--remove_input_padding=False
--random_seed=None
--use_parallel_embedding=False
--embedding_sharding_dim=0
--use_custom_all_reduce=False
--strongly_typed=True
--gather_all_token_logits=False

We constructed an encoder_output with the shape [1, 545, 1024], using float16, and repeated it four times along the batch dimension, resulting in an encoder_output with the shape [4, 545, 1024] as input for the decoder. The final decoder output predictions for batch=0 and batch=2 were the same, and batch=1 and batch=3 were the same. As mentioned above, the attention layer output is all zeros in even dimensions. Additionally, we modified the C++ code mentioned here in versions 0.7.0 and 0.9.0: https://github.com/NVIDIA/TensorRT-LLM/issues/1343.

The BERT plugin has a parameter: relative_attention_bias: Tensor = None
The relative attention bias can have the shape [num_heads, max_seq_len, max_seq_len], or the relative attention embedding table for implicit mode, [num_heads, num_buckets].
We passed a pre-constructed relative_attention_bias with the shape [num_heads, max_seq_len, max_seq_len], which resulted in the attention calculation outputting all zeros on even layers. This issue does not occur in the T5 example in example/enc because it uses the implicit mode.

The BERT plugin has a parameter: relative_attention_bias: Tensor = None The relative attention bias can have the shape [num_heads, max_seq_len, max_seq_len], or the relative attention embedding table for implicit mode, [num_heads, num_buckets].
We passed a pre-constructed relative_attention_bias with the shape [num_heads, max_seq_len, max_seq_len], which resulted in the attention calculation outputting all zeros on even layers. This issue does not occur in the T5 example in example/enc because it uses the implicit mode.

This makes more sense. Have you tried run the T5 example w/o the implicit mode? We have tested this before in earlier versions. If you can reproduce on the T5-explicit mode, please let us know

Hi @0xd8b @1096125073 , can you please provide your trt-llm version, runtime type (python or pybind of C++), model name, TP/PP setup, beam search, reproducible input examples (English preferred)? Because on our end we wasn't seeing any issue with BS>1 Examples: 0.10.0, pybind of C++, google/t5-large, TP=1 PP=1, no beam search, ["xxx", "yyy", "zzz"] And if you can reproduce your issue on TP=1 PP=1, please provide an example under this config -- it's easier for debug

yes
0.9.0, pybind of C++, Private model, similar to llama,use gpt_attention plugin, TP=2 PP=3, no beam search
for example input: "how are you?"  with batch size 4
the outputs are:

But when I tried on four A100 cards, the result was correct（4tp 1pp）
this is so wired.

@1096125073  you case is a different issue. Actually it is EXPECTED. For pybind of C++ runtime, we didn't support PP yet. It's only TP support. Because we haven't seen much use cases of enc-dec models using PP for deployment.
If this is really needed for your case, would you mind open a new issue and raise this feature request?

@1096125073 you case is a different issue. Actually it is EXPECTED. For pybind of C++ runtime, we didn't support PP yet. It's only TP support. Because we haven't seen much use cases of enc-dec models using PP for deployment.
If this is really needed for your case, would you mind open a new issue and raise this feature request?

hi,thanks a lot,i will open a new issue later.
Actually, I first used the Triton Backend to find inconsistent output before using run.py

I've found the problem; it's due to the data type of the operation data. In the Encoder and Decoder, there is a parameter called encoder_input_lengths. The documentation of the function did not specify the exact data type required for this parameter, so we did not pay attention to it. We constructed this variable using encoder_input_lengths = torch.sum(attention_mask, dim=-1), but the default data type for the torch.sum method is torch.int64. However, the requirement in TensorRT is torch.int32. This data type issue is not a problem when the batch_size is 1, but it causes the phenomenon I described earlier when the batch_size is greater than 1.

@1096125073 you case is a different issue. Actually it is EXPECTED. For pybind of C++ runtime, we didn't support PP yet. It's only TP support. Because we haven't seen much use cases of enc-dec models using PP for deployment.
If this is really needed for your case, would you mind open a new issue and raise this feature request?

Hi, I tried run. py in py_session and the result was correct, but why is the triton backend incorrect? Are there any parameters that can be adjusted.

Hi @1096125073, it's because PP is only support in Python runtime at this point. There are several runtime choices for enc-dec:

python runtime, using examples/enc_dec/run.py or examples/run.py --use_py_session
pybind of cpp runtime, using examples/run.py
triton backend, which is calling the same underlying APIs as (2)

Current status is, (1) supports TP + PP, (2) and (3) are the same and only supports TP due to the reason mentioned above (not much PP use cases for enc-dec, so it's on the roadmap but not at high priority). Does this help?
By the way, do you mean examples/run.py --use_py_session can work for enc-dec. If I remember correctly, enc-dec's Python runtime can only be run via exampels/enc_dec/run.py


[Card]: Web Components: Prod QA testing of the change to add tags to the bottom of the card component

User Story

As a [user role below]:
developer using the ibm.com Library Card

I need to:
have a version of the component that has been tested for accessibility compliance as well as on multiple browsers and platforms

so that I can:
be confident that my ibm.com web site users will have a good experience

Additional information

Browser Stack link
Browser Standard
Browser versions to be tested:  Tier 1 browsers will be tested with defects created as Sev 1 or Sev 2.  Tier 2 browser defects will be created as Sev 3 defects.
Platforms to be tested, by priority:  1)  Desktop  2)  Mobile
Mobile iOS versions: 13.1, 13.3 and 14
Mobile Android versions: 9.0 and 10
Browsers to be tested:  Desktop: Chrome, Firefox, Safari, Edge, Mobile: Chrome, Safari, Samsung Internet, UC Browser, QQ Browser
Accessibility testing guidance
Accessibility Checklist
Creating a QA bug
See the Epic (#7281 ) for the Design and Functional specs information
Final Designs Box folder link:  https://ibm.ent.box.com/folder/95514001950?s=hgvu48r1fv2ga2h0yn3qshrtxjc71vch
Web Components Dev issue (#7293 )
Once development is finished the updated code is available in the Web Components Canary Environment for testing.
React canary environment
** Web Components Wrapper test env URL**

Acceptance criteria

[ ] Accessibility testing is complete.  Component is compliant.
[ ] All browser versions are tested
[ ] All operating systems are tested
[ ] All devices are tested
[ ] Defects are recorded

@Praveen-sr This component is ready to be tested.
cc:  @ariellalgilmore


fix thread contention caused by openmp

Description
fix thread contention caused by openmp. This helps improve gluon.data.dataLoader perf when num_workers is large.
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[ ] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

@piiswrong Can you have a look?

@marcoabreu any idea why ci failed?

@piiswrong it was related to missing OpenMP:
src/initialize.cc:59:17: error: 'mxnet::engine::OpenMP' has not been declared

         engine::OpenMP::Get()->set_enabled(false);

It is caused by stop/start operation in pthread_atfork for the parent process, however, NaiveEngine cannot be stopped, which is why showing this error.
@piiswrong Do you have any comment?

Thanks. When fixing this it would be good to add a testcase for NaiveEngine

@zhreshold We can implement start and stop for naiveengine that does nothing


Not being added to list

Hello,
First of all thank you for the simple package.
I have configured your package as per instructions.
I have the following problem:

When I try to fake a list ID, I do get a Mailchimp error saying that the list does not exist, when I put the correct mailchimp list ID it works well
When I try to add an already existing email I do get the Mailchimp_List_AlreadySubscribed exception
When I try to add a non existing user, no exceptions occur, but nothing happens on my Mailchimp account and the list is not updated.

Am I missing something?
Thanks for the help!

Nevermind, I forgot you had to confirm the damned thing via email. Sorry!


Enabling required reviews for pull requests

Enabling required reviews for pull requests
Overview
Repository administrators can enforce required reviews so that pull requests must have a specific number of approving reviews before they are merged. This will help in better coordination and making sure only valid reviewed PRs are only merged.
For more info: Enabling required reviews for pull requests
Status
Open For Discussion

Sounds good! @proful @proful

Can you @johnjacobkenny enforce 2 reviewer please?

@proful I can't see the option mentioned in the link. Maybe access is restricted. Please take a look

I have enforced reviews @johnjacobkenny @arthurbuhl
Watch out for any issues

Yes it is working @proful. The reviewers though are only the people with write access. Might be a bottleneck with just us 3.

I thought anyone. Not?
Can you ask someone else to check

This doesn't seem to be working properly. Me & @PrasoonPratham approved #190, but its still saying
At least 2 approving reviews are required by reviewers with write access.

Yes any solution?

I think we need to look into Repository permission levels for an organization and upgrade few members to Team Maintainer or Collaborators roles.

@proful please take a look

Thanks @arthurbuhl I read the organization. Looks good I will try it.

🏆

The manual process is good enough
in the future, it can be re-opened.
Now cleaning up issues.


subjects with classification counts less than retirement limit retired

I have subjects like the following
487678
487941
488038
487736
487917
488026
487911
488059
488026
487911
that have classifications below the retirement limit by a significant number of clicks but are retired from workflow 16. Is this a bug in retirement or does unchecking a subject set retire all it's subjects and you cannot classify them again if you re-check in the workflow editor? If it's the latter, that wasn't clear in the documentation.
Is it possible to get these subjects that are retired but less than 20 classifications reset to unretired in subject_set 73?

most likely a bug which we know happened and it was fixed but there are data problems like this around. I've "un-retired" those subjects (there are 2 dups there by the way), is it just these ones?
Also for reference, the retired information is set on the worklfow retirement counts and it's per workflow only not subject set. Have you changed the retirement counts for the workflow at all?

Thanks. I was manually copying and apparently hit the same subject.  There's more should I give you a list?  It's about 500 subjects.

No need. I'll look it up. I'll work on the premise that retirement was always 20 for that workflow.

yep it's 20 clicks until retirement  for that workflow. It's been that way since launch. We never changed it.
It appears there's only 1 subject in  the other subsets previous uploaded  didn't hit retirement from my check. It's mainly subject set  73  that's impacted . Looks like I misremembered from early it's about 250 subjects, but some have only 6 classifications.
486757 is the new subject set i just uploaded . Thanks for fixing this.

Done - un-retired the incorrect ones (240 of them).

thanks very much


Valhelsia 1.17.1 fabric config

Took me a few days to realize that changing the CF_BASE_DIR to "/data" makes this mod pack work. Wanted to document somewhere for posterity's sake and hopefully save someone some headbanging!
docker run -d -v ~/Downloads/data:/data \
    -e TYPE=CURSEFORGE \
    -e CF_BASE_DIR="/data" \
    -e CF_SERVER_MOD="https://media.forgecdn.net/files/3505/572/Valhelsia%20Fabric-1.0.9-SERVER.zip" \
    -e MEMORY=6G \
    -e VERSION=1.17.1 \
    -p 25565:25565 -e EULA=TRUE --name mc itzg/minecraft-server

Thanks!


Run ROSCore from Docker

Feature: Develop the library EV3Dev-lang-java
In the third generation of Lego Mindstorms,
it is possible to install a complete Linux distribution and a complete Oracle JRE.
It is necessary to develop a library to use the hardware compatible with EV3Dev.

    Scenario: Develop ROS Nodes
        Given The library EV3Dev-lang-java
        Then learn ROS
        and learn how to run from Docker
        and learn to send data from robots to RosCore

http://wiki.ros.org/docker/Tutorials/Docker
https://www.youtube.com/watch?v=djLKmDMsdxM

docker pull ros

➜  mbeans git:(develop) ✗ docker run -it ros
root@15c20e508118:/# ps -l
F S   UID   PID  PPID  C PRI  NI ADDR SZ WCHAN  TTY          TIME CMD
4 S     0     1     0  0  80   0 -  4991 -      ?        00:00:00 bash
0 R     0    34     1  0  80   0 -  6920 -      ?        00:00:00 ps
root@15c20e508118:/# roscore
... logging to /root/.ros/log/f9dd0758-4c7f-11e7-b6c6-0242ac110002/roslaunch-15c20e508118-35.log
Checking log directory for disk usage. This may take awhile.
Press Ctrl-C to interrupt
Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://15c20e508118:41541/
ros_comm version 1.12.7

SUMMARY
========

PARAMETERS
 * /rosdistro: kinetic
 * /rosversion: 1.12.7

NODES

auto-starting new master
process[master]: started with pid [46]
ROS_MASTER_URI=http://15c20e508118:11311/

setting /run_id to f9dd0758-4c7f-11e7-b6c6-0242ac110002
process[rosout-1]: started with pid [59]
started core service [/rosout]

Although is possible to install ROS on Raspberry Pi 3 for example, it is better to transmit the data to a laptop to use external services.
The idea for the future ROS library for the project is the creation of a set of ROS nodes to interact with ROS services, for example SLAM.

https://github.com/diegoferigo/dockerfiles/tree/master/ROS

docker pull diegoferigo/ros

docker run -it -p 11311:11311  ros
roscore
docker ps
docker inspect e85937ffae7c | awk '/IPAddress/ || /HostPort/'
                        "HostPort": "11311"
                        "HostPort": "11311"
            "SecondaryIPAddresses": null,
            "IPAddress": "<IP_ADDRESS>",
                    "IPAddress": "<IP_ADDRESS>",

docker run -it -p 11311:11311 ros
export ROS_MASTER_URI=http://${DOCKER_HOST}:11311/

https://docs.docker.com/docker-for-mac/networking/#known-limitations-use-cases-and-workarounds

netstat -ap tcp | grep -i "listen"

tcp6       0      0  localhost.11311        *.*                    LISTEN
tcp4       0      0  *.11311                *.*                    LISTEN
tcp4       0      0  localhost.55566        *.*                    LISTEN
tcp4       0      0  *.51487                *.*                    LISTEN
tcp4       0      0  localhost.63342        *.*                    LISTEN
tcp4       0      0  localhost.6942         *.*                    LISTEN
tcp4       0      0  localhost.terabase     *.*                    LISTEN
tcp4       0      0  localhost.27017        *.*                    LISTEN
tcp4       0      0  localhost.49154        *.*                    LISTEN

https://apple.stackexchange.com/questions/254654/port-forwarding-on-macos-sierra/254777#254777

https://github.com/docker/toolbox/issues/317

docker-machine ip default
docker-machine create --driver virtualbox default
docker-machine start default

 ping <IP_ADDRESS>
PING <IP_ADDRESS> (<IP_ADDRESS>): 56 data bytes
64 bytes from <IP_ADDRESS>: icmp_seq=0 ttl=64 time=0.414 ms
64 bytes from <IP_ADDRESS>: icmp_seq=1 ttl=64 time=0.353 ms
64 bytes from <IP_ADDRESS>: icmp_seq=2 ttl=64 time=0.366 ms
64 bytes from <IP_ADDRESS>: icmp_seq=3 ttl=64 time=0.347 ms

Reported issue:
http://answers.ros.org/question/264402/osx-user-ros-with-docker/

diegoferigo/ros
docker run -it -p 11311:11311  4c8ffd80b80d
http://wiki.ros.org/ROS/EnvironmentVariables#ROS_MASTER_URI

export ROS_MASTER_URI=http://soulFactory.home:11311
WARNING: ROS_MASTER_URI [http://<IP_ADDRESS>:11311] host is not set to this machine
export ROS_IP=<IP_ADDRESS>
export ROS_MASTER_URI=http://localhost:11311

https://docs.docker.com/engine/userguide/networking/#default-networks

Connecting with a PiStorms unit with ROS Kinect installed:
robot@ev3dev:~$ ping <IP_ADDRESS>
PING <IP_ADDRESS> (<IP_ADDRESS>) 56(84) bytes of data.
64 bytes from <IP_ADDRESS>: icmp_seq=1 ttl=64 time=22.5 ms
64 bytes from <IP_ADDRESS>: icmp_seq=2 ttl=64 time=40.3 ms
64 bytes from <IP_ADDRESS>: icmp_seq=3 ttl=64 time=83.7 ms

http://wiki.ros.org/rostopic
 rostopic pub /topic_name std_msgs/String hello

Small progress:
Now in local, I register a Node to a physical ROS Kinect installation:
Ros core started
Starting listener node...
jun 25, 2017 4:29:31 PM org.ros.internal.node.client.Registrar <init>
INFORMACIÓN: MasterXmlRpcEndpoint URI: http://<IP_ADDRESS>:11311/
jun 25, 2017 4:29:31 PM org.ros.internal.node.client.Registrar onPublisherAdded
INFORMACIÓN: Registering publisher: Publisher<PublisherDefinition<PublisherIdentifier<NodeIdentifier</Listener, http://<IP_ADDRESS>:64158/>, TopicIdentifier</rosout>>, Topic<TopicIdentifier</rosout>, TopicDescription<rosgraph_msgs/Log, acffd30cd6b6de30f120938c17c593fb>>>>
jun 25, 2017 4:29:31 PM org.ros.internal.node.client.Registrar callMaster
INFORMACIÓN: Response<Success, Registered [/Listener] as publisher of [/rosout], [http://ev3dev:33975/]>
jun 25, 2017 4:29:31 PM org.ros.internal.node.topic.DefaultPublisher$1 onMasterRegistrationSuccess
INFORMACIÓN: Publisher registered: Publisher<PublisherDefinition<PublisherIdentifier<NodeIdentifier</Listener, http://<IP_ADDRESS>:64158/>, TopicIdentifier</rosout>>, Topic<TopicIdentifier</rosout>, TopicDescription<rosgraph_msgs/Log, acffd30cd6b6de30f120938c17c593fb>>>>
jun 25, 2017 4:29:31 PM org.ros.internal.node.client.Registrar onSubscriberAdded
INFORMACIÓN: Registering subscriber: Subscriber<Topic<TopicIdentifier</chatter>, TopicDescription<std_msgs/String, 992ce8a1687cec8c8bd883ec73ca41d1>>>
jun 25, 2017 4:29:31 PM org.ros.internal.node.client.Registrar callMaster
INFORMACIÓN: Response<Success, Subscribed to [/chatter], []>
jun 25, 2017 4:29:31 PM org.ros.internal.node.topic.DefaultSubscriber$1 onMasterRegistrationSuccess
INFORMACIÓN: Subscriber registered: Subscriber<Topic<TopicIdentifier</chatter>, TopicDescription<std_msgs/String, 992ce8a1687cec8c8bd883ec73ca41d1>>>

Later from the ROSMaster host, I publish a message with the following statement:
rostopic pub -r 10 /chatter  std_msgs/String "hello"

But I don´t receive any answer in the Laptop.
What is the problem?

Related issue:
https://github.com/rosjava/rosjava_core/issues/251

Related issue:
https://github.com/rosjava/rosjava_core/issues/251

Using Vagrant is enough


[$2000] Task - Task message not removed from original assignee chat when a different assignee is set for the same task

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Assign a task to User A
Verify it creates a new task report and also there is a new message in User A chat related to the task
Now go into task report, click on header and change task assignee to User B
Verify it correctly assigns the task to User B and also there is a new message in User B chat related to the task
Notice that User A still has the task message in their chat.

Expected Result:
When task assignee is changed from User A to User B, we should either remove the task message from User A chat or update the message to indicate the assignee was changed
Actual Result:
User A still has the task message even after unassigned
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[x] MacOS / Chrome / Safari
[x] MacOS / Desktop

Version Number: 1.3.32-5
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://github.com/Expensify/App/assets/93399543/2d22e751-4bbc-4696-9b83-8c7b0b1f3092
https://github.com/Expensify/App/assets/93399543/1d6b9910-162a-4edb-a1e9-3a693ea88919
Expensify/Expensify Issue URL:
Issue reported by: @huzaifa-99
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1687437127141249
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~01e874db22226abcd6
Upwork Job ID:<PHONE_NUMBER>193294848
Last Price Increase: 2023-07-03

Handling tomorrow

I think we don't need two C+ plus here, so I'm gonna unassign here!

Upped the price

This is not a bug - works as intended. This would technically be a feature request

@muttmuure @thienlnam
Proposal
Please re-state the problem that we are trying to solve in this issue.
Task message not removed from original assignee chat when a different assignee is set for the same task
What is the root cause of that problem?
When generating the report action items there's no check for assignee, so the frontend displays all loaded tasks
https://github.com/Expensify/App/blob/917c344649d1fe8101de0f58a4554f3f5dee8666/src/pages/home/report/ReportActionItem.js#L251-L264
What changes do you think we should make in order to solve the problem?

Adding a strikethrough on the task title when the task is reassigned and if desirable disable the checkbox so it can't be clicked anymore

What alternative solutions did you explore? (Optional)

Display a tag(pill button) next to title that says reassigned

Hm, this feels unexpected to me. But maybe there is more context to leaving the task in place for past assignees

Past assignees can still access the task. If we were to remove the task message from the original assignee they would not have a way to access it

@muttmuure @thienlnam should we conclude that it's better to leave the message? In my proposal I suggest for ways to highlight the reassignment while keeping the task message.
What other steps should we take for this proposal? Would posting a question in the group help with a conclusion

I agree that this isn't a bug, and technically we would consider this polish for the tasks project

@muttmuure understood will await your approval to work on the PR

IMO we should just close this unless there is a strong reason to change this

agreed. TBH my preference is that we get some customers using the tool and then if it comes up again we can respond to that real usage.
@kmwamasali we'll revisit at a later date. Thanks for your passion to work on this!


fix(docker): Fix server api 500 (ECONNREFUSED)

Should specify server not localhost.
reference: https://docs.docker.com/compose/networking/

Going to let kinghat handle this in #75 but I believe it's a proper fix. Thanks @KunoiSayami!


ARK status awk issue with zabbix-agent2

Debian default mawk doesn't support zfs.arcstats - "Value of type "string" is not suitable for value type "Numeric (unsigned)". Value "awk: program limit exceeded: maximum number of fields size=32767 FILENAME="/proc/spl/kstat/zfs/arcstats" FNR=48 NR=48"
ARC stats from /proc/spl/kstat/zfs/arcstats
UserParameter=zfs.arcstats[*],awk '/^$1/ {printf $$3;}' /proc/spl/kstat/zfs/arcstats
Gawk has no such limitation, but prints nothing while running "gawk '/^misses/ {printf $$3;}' /proc/spl/kstat/zfs/arcstats"  (with two dollar signs)
"gawk '/^misses/ {printf $3;}' /proc/spl/kstat/zfs/arcstats" returns<PHONE_NUMBER> integer as expected (with one dollar sign)
Proxmox 5 with Debian 9 stretch, gawk 4.1.4+dfsg-1, mawk 1.3.3-17+b3

This is very strange because this userparameter was never changed and is several years old. It worked fine on Debian 9.
I will have to install a Debian 9 to test it but I suppose the issue is somehow specific to Proxmox since it didn't happen on Debian 9 before.

this is no proxmox issue, this error exists on vanilla debian 9 (and on debian 10).

I don't see the issue on any Debian 10 and I also tested it on Debian 9, it works.
Could you please do this:
uname -a
cat /etc/os-release
sudo -u zabbix zabbix_agentd -t zfs.arcstats[hits]
sudo -u zabbix zabbix_agentd -t zfs.arcstats[miss]
dpkg -l|grep awk

For reference, this is what I have on one of my last Debian 9:
root@srv-201:~ # uname -a
Linux srv-201 4.9.0-6-amd64 #1 SMP Debian 4.9.88-1 (2018-04-29) x86_64 GNU/Linux
root@srv-201:~ # cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 9 (stretch)"
NAME="Debian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
root@srv-201:~ # sudo -u zabbix zabbix_agentd -t zfs.arcstats[hits]
zfs.arcstats[hits]                            [t|203642662586]
root@srv-201:~ # sudo -u zabbix zabbix_agentd -t zfs.arcstats[miss]
zfs.arcstats[miss]                            [t|40278493990]
root@srv-201:~ # dpkg -l|grep awk
ii  mawk                                1.3.3-17+b3                             amd64        a pattern scanning and text processing language

And on a Debian 10:
root@srv-328:~ # uname -a
Linux srv-328 4.19.0-10-amd64 #1 SMP Debian 4.19.132-1 (2020-07-24) x86_64 GNU/Linux
root@srv-328:~ # cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 10 (buster)"
NAME="Debian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
root@srv-328:~ # sudo -u zabbix zabbix_agentd -t zfs.arcstats[hits]
zfs.arcstats[hits]                            [t|290778]
root@srv-328:~ # sudo -u zabbix zabbix_agentd -t zfs.arcstats[miss]
zfs.arcstats[miss]                            [t|33]
root@srv-328:~ # dpkg -l|grep awk
ii  mawk                           1.3.3-17+b3                  amd64        a pattern scanning and text processing language

I'm monitoring quite a lot of Debian so I'm confident that it works. I would like to reproduce your issue but I don't see how.

Actually, could you try to replace awk by the absolute path to mawk?
 UserParameter=zfs.arcstats[*],/usr/bin/mawk '/^$1/ {printf $$3;}' /proc/spl/kstat/zfs/arcstats

Also check your alternative config:
update-alternatives --list awk

The issue may just be that gawk takes over mawk, if that's the case, using mawk directly would fix this, but it may not be possible for bsd systems to use that.

@AceSlash take a look at awk print "$$"
lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description:    Debian GNU/Linux 9.13 (stretch)
Release:        9.13
Codename:       stretch
update-alternatives --list awk
/usr/bin/mawk

awk print with double "$$"
/usr/bin/mawk '/^mfu_size/ {printf $$3;}' /proc/spl/kstat/zfs/arcstats
mawk: program limit exceeded: maximum number of fields size=32767
FILENAME="/proc/spl/kstat/zfs/arcstats" FNR=54 NR=54

awk '/^mfu_size/ {printf $$3;}' /proc/spl/kstat/zfs/arcstats
mawk: program limit exceeded: maximum number of fields size=32767
FILENAME="/proc/spl/kstat/zfs/arcstats" FNR=54 NR=54

awk print with single "$"
/usr/bin/mawk '/^mfu_size/ {printf $3;}' /proc/spl/kstat/zfs/arcstats
3979592704

awk '/^mfu_size/ {printf $3;}' /proc/spl/kstat/zfs/arcstats
3979592704

The double $$ is used by the zabbix agent to actually only use a single $. It's because zabbix uses the single $ for its own macro.
So UserParameter=zfs.arcstats[*],awk '/^$1/ {printf $$3;}' /proc/spl/kstat/zfs/arcstats doesn't actually execute awk with double $$. It does this instead:
awk '/^[ZABBIX MACRO RESULT 1]/ {printf $3;}' /proc/spl/kstat/zfs/arcstats

The double $$ is used by the zabbix agent to actually only use a single $. It's because zabbix uses the single $ for its own macro.

Ok, got it. Double $$ is valid for legacy zabbix-agent, but I'm using zabbix-agent2 and double $$ is not required in this case.

Okay, that's interesting! I'm still using the legacy agent everywhere. If that's the source of the error, I'll have to create an other file for zabbix-agent2. I will have to install it on at least one server and test it first though.

Just wanted to chime in:
I also have the exact same problem (Debian 10 with agent2) which got solved by removing the double "$" sign.

Just wanted to chime in:
I also have the exact same problem (Debian 10 with agent2) which got solved by removing the double "$" sign.

same here! Thanks for help!

Just wanted to chime in:
I also have the exact same problem (Debian 10 with agent2) which got solved by removing the double "$" sign.

same here! Thanks for help!

Just to let you know. I corrected the conf file to single $. It was running fine, zabbix-agent2, version 5.0.7
I just upgraded to version 5.0.8 and my arc stats didn't give any data.
So I set it back to $$ and arc stats is working again.

Just to let you know. I corrected the conf file to single $. It was running fine, zabbix-agent2, version 5.0.7
I just upgraded to version 5.0.8 and my arc stats didn't give any data.
So I set it back to $$ and arc stats is working again.

Seems that zabbix team reversed old behaviour with double $$ in recent zabbix-agent2 releases


Please also add your adapter to the stable repository once ready

Your adapter is already in ioBroker latest repository available to be used by testwilling users. In order to make your adapter also available for the wide user base which uses the stable repository you should also add your adapter to the stable repository. Please see instructions at https://github.com/ioBroker/ioBroker.repositories#requirements-for-adapter-to-get-added-to-the-stable-repository
Thank you for your support.

stable release to be expect in September

0.2.0 (stable release candidate) will be released today, after successfully testing next week release to stable

The stable release didn't connect at my place.
Disconnected from Tado cloud service ..., retry in 30 seconds ! This will be refused in future versions. Please report this to the developer. The id "REDACTED" has an invalid type!: Expected "string" or "object", received "number". Connected to Tado cloud, initialyzing ...
0.2.4 connected instantly and seems to work as expected.

we expect to release 0.2.6 to stable within the next 2 weeks after all testing is positive

will be released soon after fixing https://github.com/DrozmotiX/ioBroker.tado/issues/44

Some news about the stable release?

Stable version v0.3.3 launched


Add sorting on the ads screen.

https://agoradesk.com/api-docs/v1#tag/advertisement/operation/getYourAds


Add pipeline.tekton.dev/release to the namespace labels 👔

Changes

The config.webhook.pipeline.tekton.dev uses that label in its namespaceSelector..
Closes #2503
Signed-off-by: Vincent Demeester<EMAIL_ADDRESS>/cc @eddycharly @sbwsg
Submitter Checklist
These are the criteria that every PR should meet, please check them off as you
review them:

[ ] Includes tests (if functionality changed/added)
[ ] Includes docs (if user facing)
[x] Commit messages follow commit message best practices

See the contribution guide for more details.
Double check this list of stuff that's easy to miss:

If you are adding a new binary/image to the cmd dir, please update
the release Task to build and release this image.

Reviewer Notes
If API changes are included, additive changes must be approved by at least two OWNERS and backwards incompatible changes must be approved by more than 50% of the OWNERS, and they must first be added in a backwards compatible way.
Release Notes
Add pipeline.tekton.dev/release to the namespace labels

/test tekton-pipeline-unit-tests

Why not use app.kubernetes.io/part-of: tekton-pipelines instead ? 😋

/close


[Bug]: can not recognition different people if they are face feature are similarity

What Operating System(s) are you seeing this problem on?
Linux (x86-64)
dlib version
19.24
Python version
No response
Compiler
c11
Expected Behavior
No response
Current Behavior
can not recognition different people if they are face feature are similarity
Steps to Reproduce
as the example code
Anything else?
No response

Can you give more information please? A reproducible example with data is the minimum I'm afraid otherwise we can't fix anything.

Can you give more information please? A reproducible example with data is the minimum I'm afraid otherwise we can't fix anything.

How can I distinguish these two faces? Their similarity is calculated to be 0.42, while the similarity between my own photo and mine is only around 0.45.

We still need additional information.
How are you running the code? Are you detecting the faces, extracting the aligned chips to be 150×150 and then running the model, or doing something else?
Also, as far as I know, this model might underperform on non-Caucasian people.

We still need additional information. How are you running the code? Are you detecting the faces, extracting the aligned chips to be 150×150 and then running the model, or doing something else?
Also, as far as I know, this model might underperform on non-Caucasian people.

https://github.com/davisking/dlib/blob/master/examples/dnn_face_recognition_ex.cpp
this is the example what i used, they are Chinese, how can i do ?

May I ask if anyone can help me? @arrufat

May I ask if anyone can help me? @arrufat

I'm afraid there's not much I can do... maybe you can try jitter_image with several images and see if that makes it work. But I think it's kind of expected that the model underperforms with Asian people.

I'm afraid there's not much I can do... maybe you can try jitter_image with several images and see if that makes it work. But I think it's kind of expected that the model underperforms with Asian people.

I can confirm this model does not work very well with asian faces.
It says I (and another my colleague) and Daniel Wu are the same person.
Daniel Wu
@xingyuezhiyun  You can try opencv dnn method, it performs a bitter better.

Yeah it's trained mostly on American celebrities so people who don't look like them don't work as well :|

There's no way. Let me try other libraries, or if there are Asian models available, please let me know. Thank you very much!

Maybe you could train the dlib model from scratch on http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html ?

Maybe you could train the dlib model from scratch on http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html ? This website shows other datasets too which might be less biased: https://datagen.tech/blog/face-datasets/ If you do end up with a better model, maybe consider releasing the weights.

Thanks a lot ! i will try to train the model by myself and have to learn how to train the model from dlib website.

Maybe you could train the dlib model from scratch on http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html ? This website shows other datasets too which might be less biased: https://datagen.tech/blog/face-datasets/ If you do end up with a better model, maybe consider releasing the weights.

I found hard to train a dlib model  to used face dataset, I haven't found a complete training example

OK, Thank you ~


Automatic batch_size finder does not work with 16 bit and in ddp

The recursive .fit() call in this module means it can't be used with ddp interactive.
It also cannot be used with 16-bit since the scaler is not enabled and saving checkpoint fails.

@SkafteNicki

I have trouble reproducing your error. If I run pl_examples/basic_examples/gpu_template.py with --use_16bit --distributed_backend ddp and have set auto_scale_batch_size='power in trainer construction I do not get an error.

add —gpus 2

@williamFalcon is this still relevant?

@SkafteNicki could you reproduce the error?


Entra ID Protection Solution v3.0.0 not updated with latest analytic rule 'Correlate Unfamiliar sign-in properties & atypical travel alerts' version 1.0.8

Describe the bug
The Entra ID Protection Solution v3.0.0 has not been updated to v3.0.1 following an update to the analytic rule - Solutions/Microsoft Entra ID Protection/Analytic Rules/CorrelateIPC_Unfamiliar-Atypical.yaml three months ago.
To Reproduce
Steps to reproduce the behavior:

Go to Solutions/Microsoft Entra ID Protection/Analytic Rules and note the file CorrelateIPC_Unfamiliar-Atypical.yaml has a template version of 1.0.8.
Install the solution Entra ID Protection and check out the template version of 'Correlate Unfamiliar sign-in properties & atypical travel alerts' which is listed as version 1.0.6.

Expected behavior
Solution package should of been updated to version 3.0.1 and template version 1.0.8 for 'Correlate Unfamiliar sign-in properties & atypical travel alerts' be available.

Hi @MikeP324, Thanks for flagging this issue, we will investigate this issue and get back to you with some updates by 27-07-2024 . Thanks!

Hey @MikeP324, Thank you for highlighting this issue, we have created the PR with the fix and the change will get updated in upcoming solution version. Thanks!


Add a link to PlasmaBio to the gallery of JupyterHub deployments

It would be great to add a new entry to the "Gallery of JupyterHub Deployments" in the JupyterHub documentation:
https://jupyterhub.readthedocs.io/en/stable/gallery-jhub-deployments.html
Something that could be done at some point in the future once things have matured a little bit more.

Yes. Definitely a good idea @jtpio


Some fixes to write TypeDoc for typescript

This pull request fix #134 and some other following problems for typescript.

function's @param doesn't have type
constructor doesn't have @return
constructor's parameter name doesn't include constructor parameter properties (public, private)
var comment doesn't have @type

Thanks for your PR!
Please note my inline comments.

Hello,
Just trying to revive this one as ES6 classes are becoming more and more common these days :)
Good luck, and thanks in advance @kondei

@alvinsight sice @kondei seems inactive, would you like to finish this?


increase readability by using f-strings

LGTM

Thank, as always this is a fantastic PR that cleans up a lot of code!


[OSX] Application crashes due to deallocated memory access

Periodically our application crashes on OSX with logs info provided below.
Expected Behavior
Work without crashing.
Current Behavior
For example, crash log looks like:
`Crashed Thread: 9
Exception type: EXC_BAD_ACCESS(SIGSEV)
Exception Codes: KERN_INVALID_ADDRESS at 0x0000010000000022
Exception Note: EXC_CORPSE_NOTIFY
Thread 9 Crashed:
0 iohook.node 0x0000000110fa359d dispatch_proc(_uiohook_event*) + 221
1 iohook.node 0x0000000110fa757d hook_event_proc + 1709
2 com.apple.SkyLight 0x00007fff58f250b4 processDecodedEventRef(__CGEvent*, __CGEventTapProxy*) + 112
3 com.apple.SkyLight 0x00007fff58f2490d processEventTapData(void*, unsigned int, unsigned int, unsigned int, unsigned char*, unsigned int) + 543
4 com.apple.SkyLight 0x00007fff58e23bb2 _XPostEventTapData + 278
5 com.apple.SkyLight 0x00007fff58f24690 eventTapMessageHandler(__CFMachPort*, void*, long, void*) + 132
6 com.apple.CoreFoundation 0x00007fff32eb5a5b __CFMachPortPerform + 246
7 com.apple.CoreFoundation 0x00007fff32eb5959 CFRUNLOOP_IS_CALLING_OUT_TO_A_SOURCE1_PERFORM_FUNCTION + 41
8 com.apple.CoreFoundation 0x00007fff32eb58b7 __CFRunLoopDoSource1 + 527
9 com.apple.CoreFoundation 0x00007fff32e9d945 __CFRunLoopRun + 2574
10 com.apple.CoreFoundation 0x00007fff32e9cce4 CFRunLoopRunSpecific + 463
11 com.apple.CoreFoundation 0x00007fff32e9caf0 CFRunLoopRun + 40
12 iohook.node 0x0000000110fa8b74 hook_run + 1700
13 iohook.node 0x0000000110fa365e hook_thread_proc(void*) + 14
14 libsystem_pthread.dylib 0x00007fff6012633d _pthread_body + 126
15 libsystem_pthread.dylib 0x00007fff601292a7 _pthread_start + 70
16 libsystem_pthread.dylib 0x00007fff60125425 thread_start + 13`
Possible Solution
I have no idea. It looks like an access to invalid pointers.
Your Environment

Version used: 0.4.0
Environment name and version (e.g. Chrome 39, node.js 5.4): Chrome 66, Node 10.2.0, Electron 3.1.0
Operating System and version (desktop or mobile): OSX 10.14.4

I have this same issue. It seems to be related to the prompt you get for loading this library. Once you approve and close the application. The application crashes. This wont happened again unless you remove the permissions and see the prompt again. I do not know why this happens or how to fix it.

If I remove the
ioHook.on("keypress", eventHandler);

It seems to not crash. This leads me to believe that its failing to unhook this event.

maybe the same problem:
on window.  electron 5.0.11

EXCEPTION_ACCESS_VIOLATION_READ *
Assertion Error: Unknown assertion type 0x00000000

Crashed Thread: 10784

Application Specific Information:
Assertion Error: Unknown assertion type 0x00000000

Thread 10784 Crashed:
0   iohook.node                     0x5bdc1f2b          <unknown>
1   iohook.node                     0x5bdc26f2          <unknown>
2   XXX.exe                        0x44d2c5f           uv_process_async_wakeup_req (async.c:96)
3   XXX.exe                        0x34cb1d2           uv_run (core.c:519)
4   XXX.exe                        0x34c4e72           atom::NodeBindings::UvRunOnce() (node_bindings.cc:404)
5   XXX.exe                        0x29813bb           base::debug::TaskAnnotator::RunTask(char const *,base::PendingTask *) (task_annotator.cc:105)
6   XXX.exe                        0x29e76d3           base::sequence_manager::internal::ThreadControllerImpl::DoWork(base::sequence_manager::internal::ThreadControllerImpl::WorkType) (thread_controller_impl.cc:209)
7   XXX.exe                        0x1510a32           base::internal::Invoker<base::internal::BindState<void (atom::URLRequestFetchJob::*)(int) __attribute__((thiscall)),base::WeakPtr<atom::URLRequestFetchJob>,net::Error>,void ()>::RunOnce (bind_internal.h:671)

Following up on this. We also found that the new touch bar on OSX is not supported by iohooks. Which would could similar errors as mentioned above.

I confirm the touch bar crashed the app every single time.

I confirm the touch bar crashed the app every single time.

I fixed it by moving iohook to the renderer process

It seems that iohook in main process causes lots of issues on mac specifically. Will investigate but touchbar issue is not something I can address.

Not sure what the status of this issue is, but for it also crashed if during the lifetime of an Electron app an ioHook event took place. In my case if a mouse drag and mouseup event took place, then when i closed the app it would issue a similar exception. My event handlers are defined in the nodejs main process.
I solved the issue by calling ioHooks.stop(); ioHooks.unload();
Leaving this here in case it helps anyone.

Solved with
app.on('quit', () => {
  ioHook.unload();
});


fix: docker publish command.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 88.906%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
1322

Relevant Lines:
1459

💛  - Coveralls


[AutoPR containerservice/resource-manager] Adding windowsProfile and maxAgentPools property in the new 2019-04-01 api version

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/5465

(message created by the CI based on PR content)

Codecov Report

Merging #4681 into restapi_auto_dev-containerservice-Microsoft.ContainerService-2019-04-01 will decrease coverage by <.01%.
The diff coverage is 0%.

@@                                             Coverage Diff                                             @@
##           restapi_auto_dev-containerservice-Microsoft.ContainerService-2019-04-01    #4681      +/-   ##
===========================================================================================================
- Coverage                                                                    49.49%   49.49%   -0.01%
===========================================================================================================
  Files                                                                         6341     6341
  Lines                                                                       177577   177586       +9
===========================================================================================================
  Hits                                                                         87889    87889
- Misses                                                                       89688    89697       +9

Impacted Files
Coverage Δ

.../mgmt/containerservice/container_service_client.py
48.48% <0%> (-4.85%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 874ca27...a687874. Read the comment docs.


[hubzilla.org] page width broken by the "news-sticker" release element

The #news-sticker element has the width of the page but is moved to the right of the page with a position: relative;. This creates a overflow and makes an evil horizontal scrollbar appear.
I didn't find the source code of the website so I open an issue here. Please point it so I can open a PR.

Thanks for the pointer. It should definitely be position: absolute;

I can fix it if you show me where the code is.

The repository is https://github.com/anaqreon/hubzilla-website ;
however the news sticker is a one-off patch that anaqreon supplied me and was applied manually. It is not in the repository. I included it with only minimal tests done on a desktop. It has now been changed to absolute and the position adjusted slightly to compensate. I still haven't tested on a smaller screen size device but will do so later today. If you could verify, that would be great. We will probably drop the news-sticker anyway in a few weeks at most. (The colours are awful, I don't care for the jaggies introduced by rotation, and it's highlighting a transient news event with a limited shelf-life.)

Fixed by removing the news-sticker. I'd recommend integrating an announcements feed widget into the page going forward.