Update Footer & Add Google Analytics (via Google Tag Manager)

@jhusain @ktrott (updated): all test data for the analytics setup is now in and looks good to go. I'll send out access information later today.

+1


Low performance

Low performance If json data is more than 8mb with combination of multiple custom objects.
For 8mb json, it is near about 30 seconds

Hello @ssmali1505 ,
Thanks for reporting it. We are currently aware of this issue. The introspection of Obj-c is quite expensive in time. The current version is doing a lot of caching in order to speed it up. However, there are some cases in which is quite expensive.
Our tests, with JSON files of 25mb of size take 1.5 seconds to parse, compared with the 0.5 of the direct assignment. However, your case seems much worse, probably because of the complexity of your custom objects.
Therefore,  could you give us some detail on how is your json shaped? it would help us to reproduce it and work in order to improve it and make it faster.
Thanks,


Calculation of WorstIncPrb not robust to correlated income shocks

ConsIndShockModel (and its children) use a calculation of the "worst income shock probability" (CDC denotes with the Weierstrauss p) that is not robust to negative correlation between permanent and transitory shocks.  As is, the code looks for the worst permanent shock and worst transitory shock, then finds the probability of both occurring.  If the two sets of shocks are negatively correlated, their discretization is unlikely to have such a point, so WorstIncPrb will be 0.0, and MPCmax will be 1.0.
The correct procedure for finding WorstIncPrb is fairly obnoxious: use next period's mNrmMin with the entire set of shocks to get a set of aNrmMin_candidates, choose the greatest one as the actual BoroCnstNat, then sum the probabilities of the shocks that have that aNrmMin_candidate value to get WorstIncPrb.
This hasn't come up so far because the income process has uncorrelated shocks; indeed, we still need to add a function(s) to make correlated discretized RVs.

Quantecon has some methods for discretizing a handful of processes. We can
poke around there and see if they have what we need. Off the top of my
head, here
https://github.com/EconForge/Dolo.jl/blob/3450bdbfc019f74a78a22cc1803d65a0d09e7aeb/src/numeric/processes.jl#L186-L229are
the processes in Julia -- I am running out the door, but can look around
in their Python code if we think this might be useful.

Nathan M. Palmer, PhD
Computational Social Sciences
<EMAIL_ADDRESS>On Mon, Jul 10, 2017 at 9:07 AM, Matthew N. White<EMAIL_ADDRESS>wrote:

ConsIndShockModel (and its children) use a calculation of the "worst
income shock probability" (CDC denotes with the Weierstrauss p) that is not
robust to negative correlation between permanent and transitory shocks. As
is, the code looks for the worst permanent shock and worst transitory
shock, then finds the probability of both occurring. If the two sets of
shocks are negatively correlated, their discretization is unlikely to have
such a point, so WorstIncPrb will be 0.0, and MPCmax will be 1.0.
The correct procedure for finding WorstIncPrb is fairly obnoxious: use
next period's mNrmMin with the entire set of shocks to get a set of
aNrmMin_candidates, choose the greatest one as the actual BoroCnstNat, then
sum the probabilities of the shocks that have that aNrmMin_candidate value
to get WorstIncPrb.
This hasn't come up so far because the income process has uncorrelated
shocks; indeed, we still need to add a function(s) to make correlated
discretized RVs.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/econ-ark/HARK/issues/119, or mute the thread
https://github.com/notifications/unsubscribe-auth/AA-SpyCRj93HzkQkvFNa0QclGYELuqYLks5sMiIHgaJpZM4OSz3a
.

I don't really understand this: "If the two sets of shocks are negatively correlated, their discretization is unlikely to have such a point".  Unless the transitory and permanent shocks are perfectly correlated, there will always be a worst outcome for the transitory and a worst outcome for the permanent shock, and a positive probability of that event occurring ...
I think maybe the point is that an unpleasant characteristic of the current approach is that the value of the discretized minimum joint point will be strongly affected by the number of gridpoints chosen, which is a serious numerical flaw in the setup.

I was imagining that the (discrete) distribution of TransShk would vary
with the distribution of PermShk, as they would if we maintained an
equiprobable discrete distribution.  Suppose the two are negatively
correlated. At low values of PermShk, the lowest equiprobable TranShk value
is high; at high values of PermShk, the lowest equiprobable TranShkValue is
low.  Which joint (PermShk,TranShk) event is the "worst" from the
perspective of the natural borrowing constraint?  You have to check all the
points (or a plausible set of candidate points) to find out which one is
actually the most restrictive.
On Thu, Apr 25, 2019 at 7:06 PM Christopher Llorracc Carroll <
<EMAIL_ADDRESS>wrote:

I don't really understand this: "If the two sets of shocks are negatively
correlated, their discretization is unlikely to have such a point". Unless
the transitory and permanent shocks are perfectly correlated, there
will always be a worst outcome for the transitory and a worst outcome for
the permanent shock, and a positive probability of that event occurring ...
I think maybe the point is that an unpleasant characteristic of the
current approach is that the value of the discretized minimum joint
point will be strongly affected by the number of gridpoints chosen, which
is a serious numerical flaw in the setup.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/econ-ark/HARK/issues/119#issuecomment-486868814, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ADKRAFKMFR3XEMTIBMLPDKLPSI2PZANCNFSM4DSLHXNA
.

Oh, now I get it, you're right.
There's a parallel alternative to the equiprobable distribution, where there is a fixed set of points, and the way the correlation is introduced is by varying the probability weights for the joint outcomes.  For some reason my intuition was about that model instead of the one I've actually used a lot more,  which is the equiprobable one.
The solution to this, I think, is the same as for #121 (which is closely related): The boundaries should be set and there should be some very very tiny probability that you actually end up at the bound.

The solution for this (in a more complicated model) is in ConsAggShockModel.py around line 610.  Roughly, the procedure here is:

Calc aNrmMin_candidates = PermGroFacPermShkValsNext/Rfree(mNrmMinNext - TranShkValsNext).
Calc aNrmMin as the max of that (the most restrictive one).
Evaluate temp = aNrmMinRfree/(PermGroFacPermShkValsNext) + TranShkValsNext == mNrmMinNext ... Maybe use np.isclose?
Calc WorstIncShkPrb = np.dot(temp, ShkPrbsNext)

Uh, I guess I just wrote most of the code for this.  So now this is really, really easy for a first timer.

This was fixed a while ago, across the various models. Closing.


Retrieving Passwords Suffix

Running .\get-domain-admin-password.ps1 results in the following error message.  Trying to input prefix/suffix parameters does not work either.
C:\Users\Unidesk\Documents\citrix-on-gcp-master\get-domain-admin-password.ps1 : Please specify a suffix and try again.
At line:1 char:1

.\get-domain-admin-password.ps1

  + CategoryInfo          : NotSpecified: (:) [Write-Error], WriteErrorException
  + FullyQualifiedErrorId : Microsoft.PowerShell.Commands.WriteErrorException,get-domain-admin-password.ps1

Hi, thanks for your interest in citrix-on-gcp!
There are a few scripts in the repo (including the one you tried) which are designed to take action on existing deployments, namely:

resize.ps1
cleanup.ps1
get-domain-admin-password.ps1
get-domain-users.ps1

When these scripts start, they look within the specified Google Cloud project for a Deployment Manager deployment matching the name "citrix-on-gcp-suffix" where "suffix" is a 6-character alpha-numeric identifier.  Any matching deployments will be presented in a list for you to select the deployment to take action on.
Your error suggests the script can't find a deployment matching the name citrix-on-gcp-suffix.  Assuming deploy.ps1 has already been run to create that deployment, the most common cause of your error is specifying the wrong project.
All these scripts will use your gcloud default project and also allow you to override the default with a command-line parameter.
Can you verify which project you specified when you ran deploy.ps1?  Perhaps look for the citrix-on-gcp-suffix deployment in the Deployment Manager console:
https://console.cloud.google.com/dm/deployments
Once you identify the project, make sure you are running the get password script against that same project.  If necessary, you can set your default gcloud project with:
gcloud config set core/project YOUR_PROJECT_ID
Or, specify the project on the command-line, such as:
.\get-domain-admin-password.ps1 -Project YOUR_PROJECT_ID
Please try this out and let us know if you are still having issues.


Added Single Server/Client Model in Robustness Test suites

Changelog:
- Added the initialization of global variable to be used in robustness test
- Include similar tests for client-server model
Gists for Tests:
- https://gist.github.com/rahulchheda/3a9a4087bb94cdced27c380f5c483559 (SERVER_MODE)
- https://gist.github.com/rahulchheda/3347dd4268d0743d8d6bbcc8f2d4eab8 (BASIC_MODE)
Signed-off-by: Rahul M Chheda<EMAIL_ADDRESS>

Explored this. Remove some spurious new lines.

CI doesn't seem to pass for this base branch robustness-tests-2 before my changes also, that's why ignored CI/liniting issues.
cc: @pavannd1

I'd recommend running make lint, if you haven't already (I think I saw a few spots the linter might complain about).

@redgoat650 For MakeFile thanks for pointing it out, I was thinking about adding the verbose logs into a file rather than printing them. WDYT?

@redgoat650 I think we can keep this in a staging branch until all changes for the client/server model are done. WDYT? If that sounds fair, let me know the base-branch, so I could change it.

@redgoat650 I think we can keep this in a staging branch until all changes for the client/server model are done. WDYT? If that sounds fair, let me know the base-branch, so I could change it.

Yeah that sounds good to me. I created a branch robustness-tests-server-staging, you can use that as a central point in kastenhq/kopia to accumulate the client/server changes if you want. Or just use this one, either way. I'll let you know when robustness-tests-2 is done merging upstream.

@redgoat650 Merging this one, created a new one to fix linitng issues, have to test it out.


README: Revert the Coveralls badge to an SVG

The Jenkins badge is an SVG; it's just not flat. Also, the PNG looks noticeably worse. Once Jenkins gets upgraded, the changes to make the badges flat should be present, which will make our badges look consistent.

Can one of the admins verify this patch?

Haha, yeah, I know the Jenkins badge is still an SVG. I just wanted the uniformity until Shane had the time to update the AMP Jenkins cluster and we can move the flat style badge. Thanks! We'll merge this when the update happens.


Reasoning for seperate repo for v2?

Please include the language you are using, a screenshot, and copy/pastable example.Hi,
Great extension! 👍   Just was curious if there were specific reasons why v2 is aseparatee repo.

Good question, I will add it to the readme.

Why create a version 2, and not continue the old extension?

Version 2 contains a new parsing engine which should be more accurate and enable more flexibility. However as a result there are many breaking changes to the settings, and also the current language support is very limited, although I hope to grow it quickly.

thanks for the response!


Allow limited polymorphic components through attrs

Currently, next-yak does not support polymorphic components (switching elements via an as prop) like styled-components does.
This was an intentional decision for the several reasons:

Semantic HTML & Accessibility: When you create a component like styled.button, you're making a deliberate choice about its semantic meaning and accessibility behavior. HTML elements have built-in keyboard handling, focus management, and ARIA roles. Allowing arbitrary element switching via <Button as="div"> can lead to semantically incorrect HTML structure and break critical accessibility features. This affects not just user experience but also SEO and assistive technology compatibility.

Component Contract: Styled components often include specific event handlers and props tied to their element type (like disabled for buttons). Unrestricted element switching can break these assumptions and create confusing behavior:

// What happens to disabled and onClick when switched to div?
const Button = styled.button`
  &:disabled { opacity: 0.5 }
`

TypeScript Complexity: Supporting unrestricted polymorphic components requires extremely complex type definitions that need to handle all possible HTML elements while maintaining proper prop typing. This complexity makes the types harder to maintain, debug, and understand for users

However, we stumbled across some legitimate use cases where controlled element switching is valuable, like for example consistent button/link stylings
Rather than implementing unrestricted polymorphic components, we could use the attrs API for element switching at component definition time:
import { styled } from "next-yak";

// Base button component
const Button = styled.button`
  padding: 8px 16px;
  background: blue;
  color: white;
  border-radius: 4px;
  /* ... more styles ... */
`

// Need to reuse button styles for a link
const LinkButton = styled(Button).attrs({
  as: 'a'
})``;

// Usage
<Button onClick={() => {}}>Normal Button</Button>
<LinkButton href="/about">Link that looks like a button</LinkButton>

Allowing polymorphic components is not a clean approach in my opinion. When you define styles for a specific component or element, you don't think of someone changing your HTML tag, later on.
Either you start styling a dynamic element (e.g.: styled.any), where you know it will change later on and the types are accordingly (including "as" for example), or you have a dynamic mixin (not supported right now), which is somehow the same as it's not component or element specific.
Unfortunately, dynamic mixins are not possible with the current setting, but there may be another approach to doing something similar.

I agree on most points that polymorphic components are problematic. But in certain cases like our link/button implementation, i would love to solve it with that feature.
A button is a button, but the ButtonLink is a button receiving the styles of "Link" and vise versa. As we cannot solve that edge case with dynamic mixins anymore, i would appreciate having this solved with as. Of course, we can also solve this as components, but the refactoring would be quite heavy then.

In UI-architecture in general, only the smallest amount of overlapping code should be shared among components. Defining and reverse-overriding is a common anti-pattern and should be avoided.
I do not fully agree, of this being a valid use-case, because it hides most of the important complexity, like the different needs of a button and a link, here in particular. Those should be two different components and share the styles only. Already here in this case, we already need to distinguish between element styles, different browser default styles and visual styles.
import { styled } from "next-yak";

const buttonStyles = css`
  padding: 8px 16px;
  background: blue;
  color: white;
  border-radius: 4px;
  /* ... more styles ... */
`

// Button component
const Button = styled.button`
  /* overriding browser defaults */
  border: 0;

  /* visual styles */
  ${buttonStyles};

  /* button specific styles */
  /* ... */
`

// ButtonLink component
const ButtonLink = styled.a`
  /* overriding browser defaults */
  text-decoration: none;

  /* visual styles */
  ${buttonStyles};

  /* button-link specific styles */
  /* ... */
`

// Usage
<Button onClick={() => {}}>Normal Button</Button>
<LinkButton href="/about">Link that looks like a button</LinkButton>

So in order to promote minimal-dependency and more explicit code, I suggest to not introduce this dangerous "as" pattern - because this will lead ultimately to non-refactorable codebases and unnecessary complexity. I never liked it in styled-components and I like the fact, next-yak does not support it by design.

Thanks everyone for the discussion
After reading your feedback, I agree that we should stick with our current approach of not supporting polymorphic components for now.
I am closing this for now, though I'm happy to reconsider if there are good reasons for it


Arguments, can easily lead to command escape

Summary
Fix bash command injection. We used bash shell previously and pass script and arguments to the bash shell. That causes command injection and allow attackers to execute shell commands.
Instead of executing bash shell , we directly execute script configured in the configuration file. That will

Prevent command injection by using arguments.
We will not limited to bash shell.
Scripts can use any shell.
At runtime, desired shell need to be configured by system administrators and scripts must be compatible with that shell.

Ticket Link
Fixes: https://github.com/mattermost/ops-tool/issues/17

So, what happens with commands that expect arguments? For example: /ops fun figlet test
We drop argument functionallity with this, correct?

No arguments are supported and we are safe with this fix. We use command name defined in the configuration so nothing will be passed from arguments. IE
/ops fun figlet hello world ; cat /etc/password > /tmp/password.txt

Applied exec logic from here https://semgrep.dev/docs/cheat-sheets/go-command-injection/

Got it!!!  Thanks for providing the explanation.
🎖 🏅 🎖


chore: update repo by service bot

This is a routine update from cc-service-bot based on the service.yml in your repo. This PR
should be approved and merged as soon as CI passes.

CHANGELOG
FILE NAME - CHANGED BY - COMMIT MESSAGE
Makefile - framework - chore: update repo Makefile cc-mk-include v0.1186.0
cc-mk-include/compare/v0.1185.0...v0.1186.0


Is Typhoeus thread safe with basic usage?

See: https://github.com/iron-io/iron_core_ruby/issues/5

We were quite worried about this behaviour and so have been investigating it.
I have been unable to reproduce these results (I used iron.io and everything to attempt to reproduce your results @carlallen)
Sometimes the 3rd or 4th thread would return the result and the first few threads would all have blank results (as desired). This convinced me because that seems like it would have caused all threads started before it to exhibit the race condition problem and return the response that the 3rd thread just got back.
I had a few questions:

Did this problem occur regardless of headers sent?
This may seem like a harmless problem in some situations but when it comes to headers there are a few examples where it's terrible.
The first that came to mind is different 'Content-Type' heads like application/json vs. application/xml the bodies would be completely different.
Even worse 'Authorization' headers would mean different users accessing the same resource may get different results.

Were these problems maybe occuring using jRuby? I saw at least one other issue that was specific to jRuby when reading the issues.

Thanks,

I never tried jruby but I saw the same behavior in both mri and rubinius.

You could test this by creating a simple webserver that returns an incremented number on each GET request, then use a thread pool to request to the server multiple times.
Something like this:
require 'thread/pool'

pool = Thread.pool(5)

url = "http://example.com/incrementer"

5.times{pool.process{puts Typhoeus::Request.get(url).body}}

I end up with outputs like:
1
1
1
1
1

When I would expect
1
2
3
4
5

Did you just test that again? Because this test seems like it would act exactly the same as the previous. I got the iron.io test to work, but it doesn't reproduce the issue.
I always get the desired output back
{"messages":[{"id":"MESSAGE_ID","body":"Hello World","timeout":60,"push_status":{}}]}
{"messages":[]}
{"messages":[]}
{"messages":[]}
{"messages":[]}

Just tested it and it seems like it's doing what it should be. I hadn't tested this in over a year, so I can only assume the bug has since been fixed.

Hmm... looks like I haven't upgraded typhoeus since the last time, but I did change ruby versions. Let me look to see if it still fails in the old version.

Ok, looks like I was wrong. My project got upgraded to 0.6.5, and this issue seems to be fixed in that version. When I discovered this bug I was running 0.4.2. Based on what I see now, I would consider this bug fixed.

Thanks for your work @carlallen and @nathanhoel! I will close this issue then. If you run into any other problems, feel free to create a new one!


TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'

File "/home/code/Sigma/dataloader/RGBXDataset.py", line 101, in _open_image
img = np.array(cv2.imread(filepath, mode), dtype=dtype)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'
The error occurred at line 99 in the RGBXDataset.py file during runtime:
@staticmethod
def _open_image(filepath, mode=cv2.IMREAD_COLOR, dtype=None):
img = np.array(cv2.imread(filepath, mode), dtype=dtype)
return img

I have modified the code where the error occurred as shown below:
@staticmethod
def _open_image(filepath, mode=cv2.IMREAD_COLOR, dtype=None):
# img = np.array(cv2.imread(filepath, mode), dtype=dtype)
img = np.array(cv2.imread(filepath, mode))
return img
However, another issue arises.
File "/home/code/Sigma/dataloader/RGBXDataset.py", line 52, in getitem
x = cv2.merge([x, x, x])
^^^^^^^^^^^^^^^^^^^^
cv2.error: OpenCV(4.5.5) :-1: error: (-5:Bad argument) in function 'merge'

Overload resolution failed:

Can't parse 'mv'. Sequence item with index 0 has a wrong type
Can't parse 'mv'. Sequence item with index 0 has a wrong type

I have modified the code where the error occurred as shown below:

@staticmethod
def _open_image(filepath, mode=cv2.IMREAD_COLOR, dtype=None):
    img = np.array(cv2.imread(filepath, mode))
    return img

However, another issue arises. File "/home/code/Sigma/dataloader/RGBXDataset.py", line 52, in getitem x = cv2.merge([x, x, x]) ^^^^^^^^^^^^^^^^^^^^ cv2.error: OpenCV(4.5.5) 👎 error: (-5:Bad argument) in function 'merge'

Overload resolution failed:

Can't parse 'mv'. Sequence item with index 0 has a wrong type
Can't parse 'mv'. Sequence item with index 0 has a wrong type

Hi, could you print out the filepath, mode, and dtype? I'm doubting the filepath  is none in your code.

Hi, could you print out the filepath, mode, and dtype? I'm doubting the filepath is none in your code.

dtype = None
filepath = '/home/code/Sigma/datasets/MFNet/RGB/00584D.png'
mode = 4

Hi, could you print out the filepath, mode, and dtype? I'm doubting the filepath is none in your code.

dtype = None filepath = '/home/code/Sigma/datasets/MFNet/RGB/00584D.png' mode = 4

However, the following prompt will appear below:
[<EMAIL_ADDRESS>global loadsave.cpp:248 findDecoder imread_('/home/code/Sigma/datasets/MFNet/Label/00395D.png'): can't open/read file: check file path/integrity

I used the dataset download link you provided. After downloading, I found that the Label and Modal files under the MFNet dataset were empty. I wonder if this is the reason?

Sorry for the confusion. I checked Google drive and found I hadn't uploaded the label and modal folders successfully. I'm uploading it now and please try downloading it some time later. Thanks for the reminder.


[firebase_messaging] Bug with onResume and onLaunch

Hello,
When I click on a notification, it launch onResume, but when the onResume void open a new page, onResume is looped. It's the same thing with onLaunch…
Future<void> notificationClick(Map<dynamic, dynamic> message, context) async {
	print('notifClick');
	Navigator.pushNamed(context, 'test');
}

Hi @Ionys320 please can you try with the latest version of Flutter & the messaging plugin. If this issue still persists, please can you let me know and also add details such as plugin versions, and the flutter doctor output. Thanks.
Closing for now due to the age and lack of info to help investigate. Thanks.


Increasing max_mem for Large Regexps

I am trying to build a large regex using pyre2 (100k regexes ~ 2.1 MB in text form) - what are the places in the code that I have to change to handle a larger regex such as this? Is there any easy way to do this besides going through the code and identifying both the places in re2 and pyre2 that need changing? So far i've found these spots:
in the pyre2 package, i have identified these spots where max_mem is set / default param and changed them:
https://github.com/axiak/pyre2/blob/master/src/re2.cpp#L8764
https://github.com/axiak/pyre2/blob/master/src/re2.cpp#L8768
https://github.com/axiak/pyre2/blob/master/src/re2.cpp#L10745
https://github.com/axiak/pyre2/blob/master/src/re2.pyx#L762
https://github.com/axiak/pyre2/blob/master/src/re2.pyx#L904
And in the re2 package:
https://code.google.com/p/re2/source/browse/re2/re2.h#559
https://code.google.com/p/re2/source/browse/re2/compile.cc#245
Although now a large regex will compile, it will throw the DFA out of memory thing still - which leads me to believe i need to give selectively the DFA more mem - any ideas how to do this?

This is the 3rd option on the compile() function.


sentinl + search guard + kibana page cannot display

Hi
my software version is
elasticsearch 6.6.1
kibana 6.6.1
sentinl 6.6.0
search guard 6.6.1
my  elasticsearch.yml is :
searchguard.enterprise_modules_enabled: true
searchguard.ssl.transport.keystore_filepath: key/node-certificates/CN=IP-<IP_ADDRESS>-keystore.jks
searchguard.ssl.transport.keystore_password: d571f5c84856bd1d1cc9
searchguard.ssl.transport.truststore_filepath: key/truststore.jks
searchguard.ssl.transport.truststore_password: 4fc31938243ff46703f0
searchguard.ssl.transport.enforce_hostname_verification: false
searchguard.authcz.admin_dn:

CN=sgadmin
searchguard.audit.type: internal_elasticsearch
searchguard.enable_snapshot_restore_privilege: true
searchguard.check_snapshot_restore_write_privileges: true
searchguard.restapi.roles_enabled: ["sg_all_access"]
cluster.routing.allocation.disk.threshold_enabled: false
node.max_local_storage_nodes: 1
xpack.security.enabled: false

my kibana.yml is:
server.port: 5601
server.host: "<IP_ADDRESS>"
elasticsearch.hosts: ["http://localhost:9200"]
kibana.index: ".kibana"
elasticsearch.ssl.verificationMode: none
elasticsearch.requestHeadersWhitelist: [ "Authorization", "sgtenant" ]
xpack.security.enabled: false
sentinl:
es:
protocol: 'http'
results: 50
timefield: '@timestamp'
default_type: 'doc'
alarm_index: 'watcher_alarms'
alarm_type: 'sentinl-alarm'
settings:
authentication:
enabled: true
impersonate: true
username: 'admin'
password: '123456'
email:
active: true
user<EMAIL_ADDRESS>password: ******
host: smtp.163.com
ssl: false
elasticsearch.username: "kibanaserver"
elasticsearch.password: "kibanaserver"
elasticsearch.ssl.certificateAuthorities: [ "/Users/zhangtong/software/elasticsearch-1/config/key/root-ca.pem" ]
elasticsearch.ssl.verificationMode: none
xpack.security.enabled: false
my sg_roles.yml is:
sg_kibana_server:
readonly: true
cluster:
- CLUSTER_MONITOR
- CLUSTER_COMPOSITE_OPS
- cluster:admin/xpack/monitoring*
- indices:admin/template*
- indices:data/read/scroll*
indices:
'?kibana':
'':
- INDICES_ALL
'?kibana-6':
'':
- INDICES_ALL
'?kibana_':
'':
- INDICES_ALL
'?reporting*':
'':
- INDICES_ALL
'?monitoring':
'':
- INDICES_ALL
'?tasks':
'':
- INDICES_ALL
'?management-beats*':
'':
- INDICES_ALL
'watcher':
'':
- indices:data/read/search
- MANAGE
- CREATE_INDEX
- INDEX
- READ
- WRITE
- DELETE
'':
'':
- "indices:admin/aliases"
- "indices:data/read/search"
Description of the issue
sentinl install with search guard , the sentinl page cannot display correct , the page is as below:

when i only install sentinl ,the page is correct
what's wrong with it , can some one help me? thank you

does this error matters ?
log   [01:30:13.208] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:13.209] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:13.210] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:13.210] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:13.461] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:13.566] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:13.566] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:13.568] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:13.568] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:13.752] [debug][plugin] Checking Elasticsearch version
log   [01:30:13.771] [debug][stats-collection] Fetching data from kql collector
log   [01:30:13.772] [debug][stats-collection] Fetching data from kibana_stats collector
log   [01:30:13.773] [debug][stats-collection] Fetching data from kibana collector
log   [01:30:13.773] [debug][stats-collection] Fetching data from kibana_settings collector
log   [01:30:13.774] [debug][stats-collection] Fetching data from rollups collector
log   [01:30:13.779] [debug][stats-collection] not sending [kibana_settings] monitoring document because [undefined] is null or invalid.
log   [01:30:13.788] [debug][kibana-monitoring][monitoring-ui] Uploading bulk stats payload to the local cluster
log   [01:30:14.680] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:14.681] [debug][legacy-service] Request will be handled by proxy GET:/app/sentinl.
log   [01:30:14.682] [debug][legacy-proxy] Event is being forwarded: connection
respons [01:30:14.681]  GET /app/sentinl 200 63ms - 9.0B
log   [01:30:14.880] [debug][legacy-service] Request will be handled by proxy GET:/bundles/app/sentinl/bootstrap.js.
respons [01:30:14.881]  GET /bundles/app/sentinl/bootstrap.js 304 5ms - 9.0B
log   [01:30:15.019] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.019] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.020] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.020] [debug][legacy-service] Request will be handled by proxy GET:/dlls/vendors.style.dll.css.
log   [01:30:15.022] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.022] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.022] [debug][legacy-service] Request will be handled by proxy GET:/bundles/commons.style.css.
log   [01:30:15.023] [debug][legacy-service] Request will be handled by proxy GET:/bundles/sentinl.style.css.
log   [01:30:15.025] [debug][legacy-service] Request will be handled by proxy GET:/plugins/vega/index.css.
log   [01:30:15.026] [debug][legacy-service] Request will be handled by proxy GET:/plugins/tile_map/index.css.
log   [01:30:15.028] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.029] [debug][legacy-service] Request will be handled by proxy GET:/plugins/tagcloud/index.css.
respons [01:30:15.021]  GET /dlls/vendors.style.dll.css 304 15ms - 9.0B
respons [01:30:15.023]  GET /bundles/commons.style.css 304 14ms - 9.0B
respons [01:30:15.024]  GET /bundles/sentinl.style.css 304 14ms - 9.0B
respons [01:30:15.025]  GET /plugins/vega/index.css 304 14ms - 9.0B
respons [01:30:15.026]  GET /plugins/tile_map/index.css 304 14ms - 9.0B
log   [01:30:15.042] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.043] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.044] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.044] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.045] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.046] [debug][legacy-service] Request will be handled by proxy GET:/plugins/table_vis/index.css.
respons [01:30:15.030]  GET /plugins/tagcloud/index.css 304 17ms - 9.0B
log   [01:30:15.048] [debug][legacy-service] Request will be handled by proxy GET:/plugins/status_page/index.css.
log   [01:30:15.049] [debug][legacy-service] Request will be handled by proxy GET:/plugins/region_map/index.css.
log   [01:30:15.050] [debug][legacy-service] Request will be handled by proxy GET:/plugins/metrics/index.css.
log   [01:30:15.051] [debug][legacy-service] Request will be handled by proxy GET:/plugins/metric_vis/index.css.
log   [01:30:15.052] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.053] [debug][legacy-service] Request will be handled by proxy GET:/plugins/markdown_vis/index.css.
respons [01:30:15.046]  GET /plugins/table_vis/index.css 304 10ms - 9.0B
respons [01:30:15.048]  GET /plugins/status_page/index.css 304 9ms - 9.0B
respons [01:30:15.049]  GET /plugins/region_map/index.css 304 9ms - 9.0B
respons [01:30:15.050]  GET /plugins/metrics/index.css 304 8ms - 9.0B
respons [01:30:15.051]  GET /plugins/metric_vis/index.css 304 8ms - 9.0B
log   [01:30:15.060] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.060] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.061] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.061] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.062] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.062] [debug][legacy-service] Request will be handled by proxy GET:/plugins/kibana/index.css.
log   [01:30:15.063] [debug][legacy-service] Request will be handled by proxy GET:/plugins/inspector_views/index.css.
log   [01:30:15.064] [debug][legacy-service] Request will be handled by proxy GET:/plugins/input_control_vis/index.css.
log   [01:30:15.065] [debug][legacy-service] Request will be handled by proxy GET:/plugins/console/index.css.
respons [01:30:15.053]  GET /plugins/markdown_vis/index.css 304 13ms - 9.0B
log   [01:30:15.068] [debug][legacy-service] Request will be handled by proxy GET:/plugins/upgrade_assistant/index.css.
log   [01:30:15.070] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.071] [debug][legacy-service] Request will be handled by proxy GET:/plugins/cross_cluster_replication/index.css.
respons [01:30:15.063]  GET /plugins/kibana/index.css 304 11ms - 9.0B
respons [01:30:15.063]  GET /plugins/inspector_views/index.css 304 12ms - 9.0B
respons [01:30:15.064]  GET /plugins/input_control_vis/index.css 304 12ms - 9.0B
respons [01:30:15.065]  GET /plugins/console/index.css 304 12ms - 9.0B
log   [01:30:15.078] [debug][legacy-proxy] Event is being forwarded: connection
respons [01:30:15.069]  GET /plugins/upgrade_assistant/index.css 304 9ms - 9.0B
log   [01:30:15.079] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.079] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.080] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.081] [debug][legacy-service] Request will be handled by proxy GET:/plugins/remote_clusters/index.css.
log   [01:30:15.082] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.082] [debug][legacy-service] Request will be handled by proxy GET:/plugins/rollup/index.css.
log   [01:30:15.083] [debug][legacy-service] Request will be handled by proxy GET:/plugins/index_lifecycle_management/index.css.
log   [01:30:15.084] [debug][legacy-service] Request will be handled by proxy GET:/plugins/index_management/index.css.
respons [01:30:15.071]  GET /plugins/cross_cluster_replication/index.css 304 14ms - 9.0B
log   [01:30:15.086] [debug][legacy-service] Request will be handled by proxy GET:/plugins/license_management/index.css.
log   [01:30:15.087] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.088] [debug][legacy-service] Request will be handled by proxy GET:/plugins/watcher/index.css.
respons [01:30:15.081]  GET /plugins/remote_clusters/index.css 304 11ms - 9.0B
respons [01:30:15.083]  GET /plugins/rollup/index.css 304 10ms - 9.0B
respons [01:30:15.083]  GET /plugins/index_lifecycle_management/index.css 304 11ms - 9.0B
respons [01:30:15.084]  GET /plugins/index_management/index.css 304 10ms - 9.0B
log   [01:30:15.095] [debug][legacy-proxy] Event is being forwarded: connection
respons [01:30:15.086]  GET /plugins/license_management/index.css 304 10ms - 9.0B
log   [01:30:15.097] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.097] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.098] [debug][legacy-service] Request will be handled by proxy GET:/plugins/searchprofiler/index.css.
log   [01:30:15.100] [debug][legacy-service] Request will be handled by proxy GET:/plugins/monitoring/index.css.
log   [01:30:15.101] [debug][legacy-service] Request will be handled by proxy GET:/ui/favicons/favicon.ico.
log   [01:30:15.102] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.102] [debug][legacy-proxy] Event is being forwarded: connection
respons [01:30:15.088]  GET /plugins/watcher/index.css 304 15ms - 9.0B
log   [01:30:15.104] [debug][legacy-service] Request will be handled by proxy GET:/ui/favicons/manifest.json.
log   [01:30:15.105] [debug][legacy-service] Request will be handled by proxy GET:/dlls/vendors.bundle.dll.js.
respons [01:30:15.104]  GET /ui/favicons/manifest.json 304 4ms - 9.0B
respons [01:30:15.098]  GET /plugins/searchprofiler/index.css 304 13ms - 9.0B
respons [01:30:15.100]  GET /plugins/monitoring/index.css 304 12ms - 9.0B
respons [01:30:15.101]  GET /ui/favicons/favicon.ico 304 12ms - 9.0B
respons [01:30:15.105]  GET /dlls/vendors.bundle.dll.js 304 10ms - 9.0B
log   [01:30:15.705] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.706] [debug][legacy-service] Request will be handled by proxy GET:/bundles/commons.bundle.js.
respons [01:30:15.706]  GET /bundles/commons.bundle.js 304 3ms - 9.0B
log   [01:30:15.953] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:15.954] [debug][legacy-service] Request will be handled by proxy GET:/bundles/sentinl.bundle.js.
respons [01:30:15.954]  GET /bundles/sentinl.bundle.js 304 3ms - 9.0B
log   [01:30:16.264] [debug][plugin] Checking Elasticsearch version
log   [01:30:16.798] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:16.799] [debug][legacy-service] Request will be handled by proxy GET:/plugins/sentinl/style/sentinl.svg.
respons [01:30:16.799]  GET /plugins/sentinl/style/sentinl.svg 304 2ms - 9.0B
log   [01:30:16.829] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:16.830] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:16.830] [debug][legacy-service] Request will be handled by proxy GET:/api/v1/auth/authinfo.
log   [01:30:16.832] [debug][legacy-service] Request will be handled by proxy GET:/api/sentinl/time.
respons [01:30:16.834]  GET /api/sentinl/time 200 7ms - 9.0B
respons [01:30:16.831]  GET /api/v1/auth/authinfo 200 11ms - 9.0B
log   [01:30:16.860] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:16.860] [debug][legacy-service] Request will be handled by proxy GET:/bundles/af7ae505a9eed503f8b8e6982036873e.woff2.
respons [01:30:16.861]  GET /bundles/af7ae505a9eed503f8b8e6982036873e.woff2 304 2ms - 9.0B
log   [01:30:16.886] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:16.887] [debug][legacy-service] Request will be handled by proxy GET:/ui/favicons/favicon.ico.
log   [01:30:16.891] [debug][legacy-proxy] Event is being forwarded: connection
log   [01:30:16.893] [debug][legacy-service] Request will be handled by proxy GET:/plugins/searchguard/assets/searchguard_logo_nav.svg.
respons [01:30:16.887]  GET /ui/favicons/favicon.ico 304 8ms - 9.0B
respons [01:30:16.893]  GET /plugins/searchguard/assets/searchguard_logo_nav.svg 304 3ms - 9.0B
log   [01:30:18.211] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:18.212] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:18.212] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:18.213] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:18.465] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:18.566] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:18.567] [debug][legacy-proxy] "getConnections" has been called.
log   [01:30:18.568] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:18.570] [debug][kibana-monitoring][monitoring-ui] Received Kibana Ops event data
log   [01:30:18.776] [debug][plugin] Checking Elasticsearch version

Hi,
I have same issue with:
elasticsearch 6.6.1
kibana 6.6.1
sentinl 6.6.1
search guard 6.6.1 (elastic plugin 24.3 and kibana plugin 18.3)
Before i had serchguard plugins version 1 (elastic plugin 24.1 and kibana plugin 18.1) and sentinl navgiation was working fine.

Hi,
I have same issue with:
elasticsearch 6.6.1
kibana 6.6.1
sentinl 6.6.1
search guard 6.6.1 (elastic plugin 24.3 and kibana plugin 18.3)
Before i had serchguard plugins version 1 (elastic plugin 24.1 and kibana plugin 18.1) and sentinl navgiation was working fine.

Have you solved the problem now?  with the version（elastic plugin 24.3 and kibana plugin 18.3）
I have been troubled by this problem for a long time.

Hi,
I have same issue with:
elasticsearch 6.6.1
kibana 6.6.1
sentinl 6.6.1
search guard 6.6.1 (elastic plugin 24.3 and kibana plugin 18.3)
Before i had serchguard plugins version 1 (elastic plugin 24.1 and kibana plugin 18.1) and sentinl navgiation was working fine.

do you have this zip file (search-guard-6-6.6.1-24.1.zip  search-guard-kibana-plugin-6-6.6.1-18.1.zip)
can you sent them to my email<EMAIL_ADDRESS>thanks a lot

elastic plugin 24.1 and kibana plugin 18.1

thank you so much , i had to use the older version!

I have updated searchguard plugins to v.3 because i had some problems with Kibana multi tenancy. After update, searchguard is working fine but sentinl had issue.
I didn't solve this problem yet.

hi ，I build sentinl zip file from source code，it works，but still very grateful for your advice to me.

在 2019年5月7日，下午4:08，marwojt<EMAIL_ADDRESS><EMAIL_ADDRESS>写道：
searchguard

From witch branch did You take code ?

I have build it from branch-6.6.0 and still have issue

branch-6.6.0

在 2019年5月10日，下午11:09，marwojt<EMAIL_ADDRESS><EMAIL_ADDRESS>写道：
From witch branch did You take code ?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/sirensolutions/sentinl/issues/727#issuecomment-491323416, or mute the thread https://github.com/notifications/unsubscribe-auth/ABVGVGVSOZYWGNVI7BDG2BDPUWF3ZANCNFSM4HK4TDJQ.

How did we solve the issue,  for 6.6.1 stack.

andrewzjut solution didn't work for me. I still have issue with sentinl 6.6.1 and search guard kibana plugin 18.3. Temporarily i use searchguard plugin in version 18.1

I too am having the same issue with latest release versions of searchguard (.4 I believe)
Install ELK stack v6.6.0 (from yum repository on CentOS 7) with the corresponding searchguard version for both Elasticsearch and Kibana
Download the sentinl plugin through the releases link: https://github.com/sirensolutions/sentinl/releases/download/tag-6.6.0-0/sentinl-v6.6.0.zip
keep sentinl at default configuration (just want to have it running so I can create watchers and alarms through GUI).
Result: Getting the same "utc Time" and "current Time" instead of the actual values, with none of the buttons to Watcher Report etc available.
Elasticsearch.yml.txt
Kibana.log.txt
kibana.yml.txt
Elasticsearch.log
Please let me know what to do (provide more info etc)
I just didn't want to open a new issue randomly when theres the same case of it right here

kibana plugin 18.1

This solved my issue.. sorry for any inconvenience


Proxy path option

Add new "proxy path" -R option, which you can use to specify a certain path for which the requests are proxied. Other paths are not proxied.
Example:
If I want to proxy only requests done to path /api/, I can set -R /api/. Then:
GET /a.html -> not proxied
GET /api/data -> proxied
Solves issue: https://github.com/indexzero/http-server/issues/280

Actually I guess it works, issue is probably just with my AWS setup :)

Thanks for coding this idea!
First, some minor house keeping:

squash the current commits with focused commit messages
write tests!

Second, we'd need to address some of the confusion around the semantics of the command and the likely request for doing this with multiple paths. URL rewriting has come up before and #377 explores a "config-based" approach. However, keeping http-server "config-less" (or command line switches only) is also very appealing.
Consequently, things could get confusing when folks try to figure out how to use this feature. For instance:

http-server --proxy http://api.example/ - works now; everything that isn't on disk goes here
http-server --proxy http://api.example/ -R /api/ - this PR; only things not on disk and that contain this prefix
http-server -R /api/ - would fail; should it throw an error? just get ignored?
http-server --proxy http://api.example/ -R /api/ -R /a/ - not sure what would/should happen here...
http-server --proxy http://api.example/ -R /api/ --proxy http://db.example/-R /db/ - ...someone will ask for this...

Currently, the --proxy option will catch everything not on disk...and I can understand not wanting that to happen. However, because of the scenarios mentioned above, providing this -R option (which might need renaming...) would sadly add confusion, not clarity. But, I think this has merit! It just needs some more discussion/code to make it sing. 😃
There are bound to be other servers out there who handle a "path + URL" mapping from the command line. Perhaps picking up some of their tips and trips may help here.

https://github.com/txchen/light-server has a similar kind of implementation as the one I did (--proxypath <proxypath). I found it perfect for my needs.
It also has a optional config file, which might be a good way to implement the configuration (e.g. for various proxypaths) which was mentioned above.

This was almost working, except res.emit('next'); was missing:

I personally find the idea of a more complex configuration file good. There is also a good approach with #906 with the specified example.
Doing everything over cli parameters gets confusing pretty fast.


BDD tests via Github Actions

Closes #76
Done Next step is specific badge in README for BDD Tests

Codecov Report

Merging #108 (1f1f3be) into master (bfad997) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #108   +/-   ##
=======================================
  Coverage   98.65%   98.65%
=======================================
  Files           7        7
  Lines         297      297
=======================================
  Hits          293      293
  Misses          4        4

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Generated SQL not displayed in the preview

Description
SQL is actually generated and can be copied, but it is not visible in the preview
https://github.com/dbeaver/dbeaver/assets/43252954/06ee4a2f-badf-472c-a669-1461648cfa08
DBeaver Version
23.1.3
Operating System
win10
Database and driver
No response
Steps to reproduce
No response
Additional context
No response

Fixed


Report UI is no longer a static site. It only works when served with http-server

Describe the bug

Report UI index.html file could be opened statically in the browser to view results (I think in reg-cli 17.x)
But now, index.html must be served with an http server.

Reproduced step

reg-suit compare
open index.html file in browser (this is the bug. It doesn't work)
This reported issue in reg-cli project is about the same thing.

Expected behavior

opening index.html without http server opens the report.

Actual behavior

opening index.html without http server does NOT open the report. Report doesn't load.

A clear and concise description of what you actual to happen.
Screenshots
If applicable, add screenshots to help explain your problem.

https://github.com/reg-viz/reg-cli/issues/506

Closing.
Fixed here
https://github.com/reg-viz/reg-cli/issues/506#issuecomment-2300676615


Rename tests directory layout

As per the standard golang project layout 1 the directory with the tests should be called test and not tests, so we rename it here.
We should be consistent in all openstack operators repositories and follow the standard so the documentation has no discrepancies 2.

when we agree to merge this we can follow up on the install_yaml change like we did with both Glance and Cinder [1]
[1] https://github.com/openstack-k8s-operators/install_yamls/pull/506


Alice wants to play a game with between 2 people and max 8 people.

memo:
how to transfer names and the number of players users decide from the set page to the game page and the result page?

use sql [sqlite]
use object
　　└ how to create and update the object of players every time.


Error in powershell cmd for Skype for Business Server

In the section "Enable the user account with Skype for Business Server" the powershell for checking available RegistrarPool should be changed from:
Get-CsOnlineUser -Identity<EMAIL_ADDRESS>fl registrarpool
to:
Get-CsUser -Identity<EMAIL_ADDRESS>fl registrarpool
Since the article is about activating on a Skype for Business server and not Skype for Business Online

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ee417633-3d52-646b-2ef0-94f71535db75
Version Independent ID: 527bb7f0-b4a7-108c-6f86-8fadced63b86
Content: Deploy Microsoft Teams Rooms with Exchange Online
Content Source: Teams/room-systems/with-exchange-online.md
Service: msteams
GitHub Login: @LanaChin
Microsoft Alias: v-lanac

@LanaChin Could you please aid us by confirming the issue raiser's solution? Thanks

@sohailta - can you help us confirm whether the command should be changed? Thank you.

@sohailta Hi Sohail, any updates on this? Thanks!

@scanum - confirmed that its OK to make this change.  Thank you.

Merged PR. Closing issue. Thanks.


[[DOCS]] Update contribution guidelines

The JSHint website has some additional details in its version of the
contribution guidelines. Incorporate those details. Additionally,
normalize the Markdown syntax used to designate headlines.

Coverage remained the same when pulling 9d4be00b532d6e8b805d065921a3a8fe244a2ac6 on jugglinmike:update-contributing into 08c70e632f889feb8481acdc41e541ca49edfad4 on jshint:master.

Coverage remained the same when pulling 2a5c0e4b87227b2bd5c7605f1d88d7b738605aed on jugglinmike:update-contributing into 08c70e632f889feb8481acdc41e541ca49edfad4 on jshint:master.


RKE2 Cluster provisioning is flaky

What kind of request is this (question/bug/enhancement/feature request): bug
Steps to reproduce (least amount of steps as possible):

Deploy a 1 node RKE2 1.21 cluster from new dashboard

Result:
Cluster is stuck in Provisioning
Expected Result:
Cluster should come up Active
Other details that may be helpful:

Maybe related issue - https://github.com/rancher/rancher/issues/33295
Happens on single node install also

Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): master-head - latest
Installation option (single install/HA): HA/single

Closing this, will validate when RKE2 provisioning is stable. Currently its broken.


The header based routing sample fails with errors

The header based routing sample fails with errors
shavantha@shavantha-ThinkPad-X1-Carbon-4th:~/products/ballerina/ballerina-examples/examples$ ballerina test header-based-routing/

---------------------------------------------------------------------------
    T E S T S
---------------------------------------------------------------------------
---------------------------------------------------------------------------
Running Tests of Package: header-based-routing
---------------------------------------------------------------------------
ballerina: started HTTP/WS endpoint <IP_ADDRESS>:9090
Failed to execute the test function [testFunc] of test suite package [header-based-routing]. Cause: error: ballerina.mime:EntityError, message: entity body is not text compatible since the received content-type is : application/json
	at header-based-routing:testFunc(header-based-routing-test.bal:34)

ballerina: stopped HTTP/WS endpoint <IP_ADDRESS>:9090

Tests run: 1, Passed: 0, Failures: 1, Skipped: 0 - in TestSuite

failed tests:
 testFunc: Failed to execute the test function [testFunc] of test suite package [header-based-routing]. Cause: error: ballerina.mime:EntityError, message: entity body is not text compatible since the received content-type is : application/json
	at header-based-routing:testFunc(header-based-routing-test.bal:34)

---------------------------------------------------------------------------
Results:

Tests run: 1, Passed: 0, Failures: 1, Skipped: 0
---------------------------------------------------------------------------
Summary:

header-based-routing............................................... FAILURE
---------------------------------------------------------------------------

duplicate of https://github.com/ballerina-platform/ballerina-examples/issues/173


GitHub Webhook client locks up hyper after 1 request

Here's a minimal repro:
extern crate hyper;

use hyper::server::{Request, Response};
use std::io::Read;

// If a github webhook client requests this route, after serving that request successfully
// it will never respond to another request from any client again.
fn hello(req: Request, res: Response) {
    let mut req = req;
    println!("request received, processing");
    println!("loading body into string");
    let mut payload = String::new();
    if req.read_to_string(&mut payload).is_err() {
        println!("could not read body into string");
        return res.send(b"nope").unwrap();
    }
    println!("done, responding");
    res.send(b"yep").unwrap();
}

fn main() {
    let _listening = hyper::Server::http("<IP_ADDRESS>:4200").unwrap()
        .handle(hello);
    println!("Listening on <IP_ADDRESS>:4200");
}

This responds perfectly fine to curls but if this is set to be a GitHub webhook receiver, the server will stop accepting requests after it successfully serves the first one.

This is a dupe of #368


[Snyk] Upgrade html-snapshots from 2.15.0 to 2.17.0

This PR was automatically created by Snyk using the credentials of a real user.Snyk has created this PR to upgrade html-snapshots from 2.15.0 to 2.17.0.
:information_source: Keep your dependencies up-to-date. This makes it easier to fix existing vulnerabilities and to more quickly identify and fix newly disclosed vulnerabilities when they affect your project.

The recommended version is 2 versions ahead of your current version.
The recommended version was released a day ago, on 2024-02-05.

Release notes

Package name: html-snapshots

2.17.0 -<EMAIL_ADDRESS>

2.16.0 -<EMAIL_ADDRESS>

2.15.0 -<EMAIL_ADDRESS>

    from html-snapshots GitHub release notes

Commit messages

Package name: html-snapshots

2fa0371 Merge pull request #628 from localnerve/rc-2.17.0
33c917f @ 2.17.0 -<EMAIL_ADDRESS>9871dac Merge pull request #627 from localnerve/snyk-upgrade-69e1862e8fdf7b29a5cc0359632008f6
1b97ba0 fix: upgrade html-snapshots from 2.15.0 to 2.16.0
4a3f379 Merge pull request #626 from localnerve/snyk-upgrade-42b6aab7a009e4fe7e629da545ca6fd2
b54f597 fix: upgrade html-snapshots from 2.15.0 to 2.16.0
b98c226 Merge pull request #625 from localnerve/snyk-upgrade-32c147e4cde16b926fe5eb7f1bac67ce
5247c69 fix: upgrade html-snapshots from 2.15.0 to 2.16.0
2668630 Merge pull request #623 from localnerve/snyk-upgrade-dfe038349b8dd34fefaf01358e43be8b
e9c5731 fix: upgrade html-snapshots from 2.15.0 to 2.16.0
74a5b27 Merge pull request #622 from localnerve/snyk-upgrade-46075fdaea563c9699729d8c40ad7916
f7fd0c1 fix: upgrade html-snapshots from 2.15.0 to 2.16.0
79a1616 Merge pull request #621 from localnerve/snyk-upgrade-8387b982e6df0844b37cbea138029a09
06cd91c fix: upgrade html-snapshots from 2.14.0 to 2.15.0
648ec01 Merge pull request #620 from localnerve/rc-2.16.0
493dfe5 @ 2.16.0 -<EMAIL_ADDRESS>25d7fec Merge pull request #619 from localnerve/snyk-upgrade-c202da5362cf1d47dbf59a5ed47655d6
f2a9860 fix: upgrade html-snapshots from 2.14.0 to 2.15.0
1fe22ed Merge pull request #617 from localnerve/snyk-upgrade-565dd7840ef220ad657414a0c7f0f9c7
0b0b118 fix: upgrade html-snapshots from 2.14.0 to 2.15.0
9642a18 Merge pull request #616 from localnerve/snyk-upgrade-cdefe55c5a200913f7de36b561edcd72
c9f95e4 fix: upgrade html-snapshots from 2.14.0 to 2.15.0
bc26542 Merge pull request #615 from localnerve/snyk-upgrade-b3c6a28e204ee939224a16e03a157f3d
63839b0 fix: upgrade html-snapshots from 2.14.0 to 2.15.0

Compare

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open upgrade PRs.
For more information:
🧐 View latest project report
🛠 Adjust upgrade PR settings
🔕 Ignore this dependency or unsubscribe from future upgrade PRs

coverage: 99.245%. remained the same
when pulling dfde1db99b26257b822b00e21b471c5d04917339 on snyk-upgrade-adb46ae02354e5204c4049b0c6091aa1
into<PHONE_NUMBER>babe2d2250d935c38872d2a17832b8 on master.


Add ability to print whole response in check-http

This PR is a proposition of two changes:

Add the -w or --whole-response to the check-http.rb check. When the check is failing, the whole message received will be displayed in the message
Add the intellij project files to ignored in gitignore.

Can you make a pr against sensu-plugins-http please.
Thanks for this!

Great, thanks for merging, :).
I'll create a PR to sensu-plugins-http right now.

@mattyjones as you requested, the PR is created: https://github.com/sensu-plugins/sensu-plugins-http/pull/7


Extra keyword and backslashes when using Compression

Describe the bug
When using compression on a single column, the cqlreplicator adds extra characters causing backward compatibility issues

The field name of the source compressed column  is added to the actual compressed field value
Backslashes is added to each of key/value element of the json data

To Reproduce
Steps to reproduce the behavior:
Input compression configuration in cqlreplicator
"compressionConfig": {
"enabled": true,
"compressAllNonPrimaryColumns": false,
"compressNonPrimaryColumns": ["metadata"],
"targetNameColumn": "metadata_compressed"
}
Output of compression (after decompression) in the metadata_compressed field
'{"metadata":"{\"deviceId\":{\"ndsId\":\"9af86174-2a42-11ec-8f03-b58eaeebc034\"},\"identifier\":{\"value\":\"123456789\"}'
Expected behavior
{"deviceId":{"ndsId":"9af86174-2a42-11ec-8f03-b58eaeebc034"},"identifier":{"value":"123456789"}}
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.

@hindprak I pushed the changes to this branch. Could you please validate and let me know the result

Thanks @nwheeler81 . I will do a quick test

@nwheeler81 A quick sanity check on one of tables we loaded, looks good. We will do a full functional test after loading all tables. Thank you very much.

@nwheeler81 Functional test on compression/decompression works as expected. Thank you very much


[lidarr] Lidarr won't start.

Which addon?

Addon name : Lidarr
Addon version : <IP_ADDRESS>92-ls90

Describe the bug

The add-on won't start. I have uninstalled it and reinstalled it and it won't start. All my settings are correct.
To Reproduce

**Full addon log

Configuration
Log
Lidarr NAS
|| |/ ||  _/
Brought to you by linuxserver.io
To support the app dev(s) visit:
Lidarr: https://opencollective.com/lidarr
To support LSIO projects visit:
https://www.linuxserver.io/donate/
GID/UID
User uid:    0
User gid:    0
[cont-init.d] 10-adduser: exited 0.
[cont-init.d] 20-folders.sh: executing...
[cont-init.d] 20-folders.sh: exited 0.
[cont-init.d] 30-config: executing...
[cont-init.d] 30-config: exited 0.
[cont-init.d] 90-custom-folders: executing...
[cont-init.d] 90-custom-folders: exited 0.
[cont-init.d] 92-local_mounts.sh: executing...
[cont-init.d] 92-local_mounts.sh: exited 0.
[cont-init.d] 92-smb_mounts.sh: executing...
Mounting smb share(s)...
[21:33:39] INFO: ... //<IP_ADDRESS>/Media successfully mounted to /mnt/Media with options
[cont-init.d] 92-smb_mounts.sh: exited 0.
[cont-init.d] 99-custom-files: executing...
[custom-init] no custom files found exiting...
[cont-init.d] 99-custom-files: exited 0.
[cont-init.d] done.
[services.d] starting services
[services.d] done.
[Info] Bootstrap: Starting Lidarr - /app/lidarr/bin/Lidarr.dll - Version <IP_ADDRESS>92
[Debug] Bootstrap: Console selected
[Info] AppFolderInfo: Data directory is being overridden to [/config/addons_config/lidarr]
[Fatal] ConsoleApp: EPIC FAIL!
[v<IP_ADDRESS>92] System.IO.InvalidDataException: Failed to load configuration from file '/config/addons_config/lidarr/config.xml'.
---> System.Xml.XmlException: Root element is missing.
at System.Xml.XmlTextReaderImpl.Throw(Exception e)
at System.Xml.XmlTextReaderImpl.ParseDocumentContent()
at System.Xml.XmlTextReaderImpl.Read()
at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)
at System.Xml.XmlDocument.Load(XmlReader reader)
at Microsoft.Extensions.Configuration.Xml.XmlDocumentDecryptor.CreateDecryptingXmlReader(Stream input, XmlReaderSettings settings)
at Microsoft.Extensions.Configuration.Xml.XmlStreamConfigurationProvider.Read(Stream stream, XmlDocumentDecryptor decryptor)
at Microsoft.Extensions.Configuration.Xml.XmlConfigurationProvider.Load(Stream stream)
at Microsoft.Extensions.Configuration.FileConfigurationProvider.Load(Boolean reload)
--- End of inner exception stack trace ---
at Microsoft.Extensions.Configuration.FileConfigurationProvider.HandleException(ExceptionDispatchInfo info)
at Microsoft.Extensions.Configuration.FileConfigurationProvider.Load(Boolean reload)
at Microsoft.Extensions.Configuration.FileConfigurationProvider.Load()
at Microsoft.Extensions.Configuration.ConfigurationRoot..ctor(IList1 providers)    at Microsoft.Extensions.Configuration.ConfigurationBuilder.Build()    at NzbDrone.Host.Bootstrap.GetConfiguration(StartupContext context) in D:\a\1\s\src\NzbDrone.Host\Bootstrap.cs:line 202    at NzbDrone.Host.Bootstrap.CreateConsoleHostBuilder(String[] args, StartupContext context) in D:\a\1\s\src\NzbDrone.Host\Bootstrap.cs:line 109    at NzbDrone.Host.Bootstrap.Start(String[] args, Action1 trayCallback) in D:\a\1\s\src\NzbDrone.Host\Bootstrap.cs:line 68
at NzbDrone.Console.ConsoleApp.Main(String[] args) in D:\a\1\s\src\NzbDrone.Console\ConsoleApp.cs:line 45
Press enter to exit...
[Info] Bootstrap: Starting Lidarr - /app/lidarr/bin/Lidarr.dll - Version <IP_ADDRESS>92
[Debug] Bootstrap: Console selected
[Info] AppFolderInfo: Data directory is being overridden to [/config/addons_config/lidarr]
[Fatal] ConsoleApp: EPIC FAIL!
[v<IP_ADDRESS>92] System.IO.InvalidDataException: Failed to load configuration from file '/config/addons_config/lidarr/config.xml'.
---> System.Xml.XmlException: Root element is missing.
at System.Xml.XmlTextReaderImpl.Throw(Exception e)
at System.Xml.XmlTextReaderImpl.ParseDocumentContent()
at System.Xml.XmlTextReaderImpl.Read()
at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)
at System.Xml.XmlDocument.Load(XmlReader reader)
at Microsoft.Extensions.Configuration.Xml.XmlDocumentDecryptor.CreateDecryptingXmlReader(Stream input, XmlReaderSettings settings)
at Microsoft.Extensions.Configuration.Xml.XmlStreamConfigurationProvider.Read(Stream stream, XmlDocumentDecryptor decryptor)
at Microsoft.Extensions.Configuration.Xml.XmlConfigurationProvider.Load(Stream stream)
at Microsoft.Extensions.Configuration.FileConfigurationProvider.Load(Boolean reload)
--- End of inner exception stack trace ---
at Microsoft.Extensions.Configuration.FileConfigurationProvider.HandleException(ExceptionDispatchInfo info)
at Microsoft.Extensions.Configuration.FileConfigurationProvider.Load(Boolean reload)
at Microsoft.Extensions.Configuration.FileConfigurationProvider.Load()
at Microsoft.Extensions.Configuration.ConfigurationRoot..ctor(IList1 providers)    at Microsoft.Extensions.Configuration.ConfigurationBuilder.Build()    at NzbDrone.Host.Bootstrap.GetConfiguration(StartupContext context) in D:\a\1\s\src\NzbDrone.Host\Bootstrap.cs:line 202    at NzbDrone.Host.Bootstrap.CreateConsoleHostBuilder(String[] args, StartupContext context) in D:\a\1\s\src\NzbDrone.Host\Bootstrap.cs:line 109    at NzbDrone.Host.Bootstrap.Start(String[] args, Action1 trayCallback) in D:\a\1\s\src\NzbDrone.Host\Bootstrap.cs:line 68
at NzbDrone.Console.ConsoleApp.Main(String[] args) in D:\a\1\s\src\NzbDrone.Console\ConsoleApp.cs:line 45
Press enter to exit...
Full addon config

System

Supervisor version: 2022.07.0
Host system version: 8.3

Hi, as noted in your log your config file is invalid. Please remove it and a new one will be generated /config/addons_config/lidarr/config.xml'. ---> System.Xml.XmlException: Root element is missing.

Wow thanks. I didn't realise it was such an easy fix.
Also, Thanks for the super quick response!


Use a docker deployment where docker.sock is not available

Kubernetes clusters (at least in IKS v1.11.x onwards) that uses containerd as its container runtime will not have the docker.sock available on the worker nodes. One way is to use Docker in a container and let the peers connect to that to have its chaincode containers built and run.
Related PR from another repo https://github.com/IBM/blockchain-network-on-kubernetes/pull/28/files

fixed at #24


Add publishing api path reservation test helpers...

Part of https://trello.com/c/bf4nuPIc/340-move-url-arbitration-to-publishing-api
Moves url arbiter test helpers.
Note I've omitted the :get stubs in a couple of the helpers as these weren't used in Panopticon.

@alext, @danielroseman thanks for review, updated.


Seidel's algorithm

Try Seidel's algorithm for Q4:
https://gist.github.com/szarnyasg/2111d93933b605633ed7ddcd60470630

See also Tiskin's algorithm in https://arxiv.org/abs/1512.00066


anonymize google analytics

anonymize ips
disable cookie storage

Thanks Min! Definitely need this for GDPR.
On Mon, Apr 9, 2018 at 12:36 PM, Matthias Bussonnier <
<EMAIL_ADDRESS>wrote:

Merged #279 https://github.com/jupyter/jupyter.github.io/pull/279.
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHub
https://github.com/jupyter/jupyter.github.io/pull/279#event-1564625093,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABr0Lkb_O9fuhmn79d-lgMUkQRdm_1Gks5tm7g_gaJpZM4TMkRB
.

--
Brian E. Granger
Associate Professor of Physics and Data Science
Cal Poly State University, San Luis Obispo
@ellisonbg on Twitter and GitHub
<EMAIL_ADDRESS>and<EMAIL_ADDRESS>


update docs to move loading to end

this ensures the mv-login listener is added before the event is fired

Thanks!


How do we restrict number of image/video selection to 1?

you need to it in your code, the native file picker is not allowing to have a single selection

Thanks


full OpenCL C?

Would you accept patches to reach full OpenCL C compliance? Or is that a clear non-goal of the project?

I'll leave it to @dneto0 to have the final say, but from my perspective - I think it'd be great to implement all of OpenCL C (or at least as close to 100% as we could get).
The list of restrictions in https://github.com/google/clspv/blob/master/docs/OpenCLCOnVulkan.md was more to do with the set of kernels we had to get ported from OpenCL C to Vulkan SPIR-V, not necessarily things that couldn't be implemented.
For example, you could implement the vector of 8/16 elements types by using Vulkan matrices or a struct of vectors, but given the kernels we were targeting did not have this pattern it wasn't worth the engineering effort.

There's a few levels of support we could imagine:

level 0: things we can relatively easily map to Vulkan compute shaders today (with variable pointers and 16bit storage), and driven by the samples we based this work on.  We've got many bugs to fix before we can call this stable
level 1: things that, with more work in the compiler, still could map to Vulkan (with variable pointers and 16bit storage).  Example: Adding vectors of 8 or 16 elements.
level 2: Like 1, but using more Vulkan features, e.g. shaderFloat64
level 3: Like 2, but possibly defining more Vulkan extensions.  This would need to be done with cooperation of the Vulkan and maybe SPIR-V working groups.

My current focus is on getting level 0 stabilized.  The others would be nice but are far lower priority for me.  I'd accept patches for 1 and 2 as long as they don't make stability at level 0 worse or the code quality vastly worse.
(And yes, I should do a better job of communicating this.... )

Thanks for the replies. To give some background, we are evaluating using clspv from Mesa/clover for OpenCL. Mesa already contains a translator from Vulkan SPIR-V to NIR, from which drivers can generate native code.
I'm assuming from the above that you wouldn't want for clspv to generate SPIR-V that isn't compliant with Vulkan?

That is an interesting use case! Any contributions that conform to Vulkan SPIR-V would be welcome of course 😄

@tomeuv My impression (as a user of clspv) is that clspv is mostly intended to enable OpenCL C code to be reused in an environment that consumes SPIR-V's shader variant. There exist compilers (even open compilers) that compile OpenCL C into SPIR-V's kernel variant (the form that OpenCL runtimes consume).
So, if you want a compiler that emits SPIR-V and consumes all of OpenCL C, take a look at https://github.com/KhronosGroup/SPIR/tree/spirv-1.0 . If, in contrast, you want a compiler that emits SPIR-V that will run in Vulkan (or runtimes that resemble Vulkan more closely than they resemble OpenCL), keep poking at clspv. The catch with this latter case is that there are structures in OpenCL C that are, at best, difficult to represent in Vulkan.

+1 to what @ericberdahl said.

I'm assuming from the above that you wouldn't want for clspv to generate SPIR-V that isn't compliant with Vulkan?

I'm focused on Vulkan, including how Vulkan evolves over time.
But I'm not going to definitively say "no" to something else.  But you would have to be more specific for me to give a more specific answer.
Am I interested in having clspv generate NIR?  Not really.   I think it's better to go through SPIR-V (for Vulkan) as an intermediate, and that problem is solved as far as I can tell.

So, if you want a compiler that emits SPIR-V and consumes all of OpenCL C, take a look at https://github.com/KhronosGroup/SPIR/tree/spirv-1.0 .

Yes, but I have another requirement, which is that this can be properly distributed by third parties from pretty much the start. So Khronos' compiler isn't in the right shape because of being a LLVM fork, even if it's functionally closer to what I need.
Clspv is in the right shape, but there's a big functionality gap. But we can start right away without a long period refactoring LLVM or Khronos' compiler (or most likely, both).

Am I interested in having clspv generate NIR? Not really. I think it's better to go through SPIR-V (for Vulkan) as an intermediate, and that problem is solved as far as I can tell.

We are planning to use the SPIR-V to NIR translator that is already in Mesa. We also want to have SPIR-V in the middle because the same Mesa drivers will want to gain support for OpenCL 2.1 and Vulkan at some point.


Comparison with ocaml-posix and ExtUnix

Hi! Thanks for this interesting project!
I'm wondering how it compares to savonet/ocaml-posix (ctypes-generated bindings) and ExtUnix (hand-written bindings for various libc, POSIX, Unix, and Windows APIs). Could you explain how libc.ml differs?

Hi @MisterDA! Thanks for asking, libc.ml will eventually be fully generated with ocaml-bindgen but I just really needed some of these constants in place to build a few things for Riot.
And by fully generated I mean that we will essentially have a big thick .h that includes all of the things we need for a given platform, and use the ocaml-bindgen tool to automatically generate all the OCaml constants, values, externals, etc, and all the C shim code needed to access system libraries.
Hope this helps!

Thanks for the explanation :)


Clash development: to-do list

[ ] Remove ctxs because they seem to be useless and we don't even have one bc it's an automatic loop
[ ] Format output of getBans
[x] Find out how riot refers to match "status" vs roster "state" (Done, see https://discord.com/channels/713343823962701897/784087009974681650/973462987350376458)
[ ] Siz and Adam need to fill in their lane's champs in globalChampionDict
[ ] Put the champion preference list into a separate file for easier editing
[ ] Error handling in checkClashLoop (probably just need a generic handler for all things HTTP)
[ ] Migrate key storage system onto Dotenv

Helpful links
Riot's LOL documentation page
https://developer.riotgames.com/docs/lol
Riot's APIs (pointing to clash)
https://developer.riotgames.com/apis#clash-v1
An overview of interfacing with the LCU
https://hextechdocs.dev/getting-started-with-the-lcu-api/
The LCU's documentation
https://www.mingweisamuel.com/lcu-schema/tool/#/
Python requests lib: the Response object and what to do with it
https://www.w3schools.com/python/ref_requests_response.asp
A refresher on HTTP status codes
https://developer.mozilla.org/en-US/docs/Web/HTTP/Status

New patch, new todos! These are each a fairly big task in its own right.

[ ] Progress bar for clash scouting
[ ] Live Drafting: continuously receive picks from client and update picks
[ ] Synergy Drafting: add a synergies doc, where synergy strength will help modify champion recommendations mid-draft
[ ] Cache champion names and icons


Type conversion for sqlite data types

Request for comments:
It would be useful if this library included common type conversions.  In one common pattern, I'd convert sql NULL to None; in the other pattern I'd raise an exception for any value that could not be converted.
The existing to_string function is a convenient way to guarantee a string, but it behaves differently.
Since it coerces any data type to a string, I renamed it to_string_coerce to differentiate it from to_string and to_string_exn.  Is there a better name for that style of conversion?
The end result is a pattern that looks like this:
assert ((Data.to_string_exn (column select_stmt 0)) = "Hi Mom");

or
assert ((Data.to_string (column select_stmt 0)) = Some "Hi Mom");

I'm curious if you think we should improve the pattern further, such as by replacing the call to column?  For example, we could simplify it further to look like this:
assert ((get_string select_stmt 0) = Some "Hi Mom");

@mmottl  thanks for merging the other two changes!
Having looked at this for a few more days, I think I'd like to be able to support this pattern, which would return None for null and reduce the amount of typing when fetching data from columns:
assert ((column_to_string select_stmt 0) = Some "Hi Mom");

Removing the [RFC] tag - I think this is solid enough to propose as-is.

Sorry for the long delay.  I've made some name changes to the conversion functions and improved the implementation.  Could you please check whether you are happy with the current state?


Saving and loading with an empty model layer

Click to expand!
Issue Type
Bug
Source
binary
Tensorflow Version
v2.8.0-rc1-32-g3f878cff5b6 2.8.0
Custom Code
No
OS Platform and Distribution
Ubuntu 20.04
Mobile device
No response
Python version
3.8.10
Bazel version
No response
GCC/Compiler version
No response
CUDA/cuDNN version
No response
GPU model and memory
No response
Current Behaviour?
When trying to load a saved keras model containing an empty sequential model, an exception is thrown.

Standalone code to reproduce the issue
import tensorflow as tf
import numpy as np

class TestBlock(tf.keras.Model):
  def __init__(self):
    super().__init__()
    self.shortcut = tf.keras.Sequential()
    self.dense = tf.keras.layers.Dense(5)
    self.relu = tf.keras.layers.ReLU()

  def call(self, input_vector):
    shortcut = self.shortcut(input_vector)
    dense = self.dense(input_vector)
    return self.relu(shortcut + dense)

if __name__ == "__main__":
  model = TestBlock()
  model.build((1,5))
  model.compile(loss="categorical_crossentropy")
  checkpoint_callback = tf.keras.callbacks.ModelCheckpoint(
    filepath="checkpoints",
    save_best_only=True,
    mode="auto",
  )
  train_data = tf.data.Dataset.from_tensor_slices((np.ones((20,5)), np.zeros((20,5)))).batch(1)
  model.fit(train_data,
    epochs=1,
    callbacks=[checkpoint_callback],
  )
  print("Saving ...")
  model.save("test_model")
  print("Loading ...")
  loaded_model = tf.keras.models.load_model("test_model")

Relevant log output
2022-08-19 12:17:00.131391: I tensorflow/core/platform/cpu_feature_guard.cc:151] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in pe
rformance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-08-19 12:17:00.599398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1525] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 6666 MB memory:  -> device: 0, name: NVIDIA GeForce RTX 206
0 SUPER, pci bus id: 0000:29:00.0, compute capability: 7.5
20/20 [==============================] - 0s 1ms/step - loss: 0.0000e+00ING:tensorflow:Can save best model only with val_loss available, skipping.
Saving ...
2022-08-19 12:17:01.354210: W tensorflow/python/util/util.cc:368] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
Loading ...
Traceback (most recent call last):
  File "test_seq_model.py", line 34, in <module>
    loaded_model = tf.keras.models.load_model("test_model")
  File "/xxxxx/keras/utils/traceback_utils.py", line 67, in error_handler
    raise e.with_traceback(filtered_tb) from None
  File "/xxxxx/keras/saving/saved_model/load.py", line 700, in _reconstruct_model
    if config['layers'][0]['class_name'] == 'InputLayer':
IndexError: list index out of range

@stridge-cruxml,
Could you please try loading the model with tf.saved_model.load("PATH"). I tried the alternative approach and was able to load the model without any issue. Kindly find the gist of it here. Thank you!

@tilakrayal thanks for the quick response!
Yes, I found that work around. However this is not ideal as it loads as tensorflow model not keras model.
The other work around (if its just a shortcut layer) is to use tf.keras.layer.Layer() instead of Sequential().
But my purpose of reporting this, is this is a case that should work and should be supported but isn't.

@stridge-cruxml,
Thanks for opening this issue. Development of keras moved to another repository.
Could you please post this issue on keras-team/keras repo.
To know more please refer:
https://discuss.tensorflow.org/t/keras-project-moved-to-new-repository-in-https-github-com-keras-team-keras/1999
Thank you!


How to authenticate commands in CI

I am trying to setup deployments on merge and I created a service account that output to a file in github actions and then run the nx deploy command while setting the GOOGLE_APPLICATION_CREDENTIALS env var to the service account json file to use for auth but it fails with
Error: Failed to authenticate, have you run firebase login?

Hi @kdawgwilk  - you need to set a FIREBASE_TOKEN variable in your CI environment.
More Info here 👍
https://firebase.google.com/docs/cli#cli-ci-systems

From what I have found on the Interwebs 😅 that flow is deprecated https://stackoverflow.com/questions/75653962/firebase-token-deprecated-in-ci-cd-gitlab

ah ok thats good to know, will have to keep an 👀 on that then!
so although its warning that its deprecated, it'll still work for now anyway I guess 👍


KILL QUERY won't finish

I have a query running that blocks some other queries in queue.
I tried to kill it with
KILL QUERY where query_id = 'f7373965-0605-45a2-878e-ed158bf88e64' SYNC;

However, the query seems it's blocked by something as well and won't finish. It hangs on
→ Progress: 40.00 rows, 64.52 KB (391.03 rows/s., 630.72 KB/s.)  99%Cannot load data for command line suggestions: Code: 209, e.displayText() = DB::NetException: Timeout exceeded while reading from socket (<IP_ADDRESS>:9000): while receiving packet from localhost:9000, <IP_ADDRESS>, e.what() = DB::NetException

Is there any other way to force kill it?

Duplicate of https://github.com/yandex/ClickHouse/issues/1576 and #3964


Running > 1 containers with unpulled image results in already exists

Fresh rancher and host. Use rancher-compose and run up 2 containers using the same image but potentially different versions (shared layers).
One of them can error out with an already exists message (either for the layer or the image). Sorry I don't have more data, it happened quickly. Not sure if this is considered an upstream issue with docker or docker compose.

@flaccid My random guess sounds like this is more of a Docker issue.  Would need a bit more info.  If you have the /var/log/rancher/agent.log files from the Docker host the error you saw should be in there.

We just recently added some directions on how to retrieve the agent.log files in our FAQs.
http://docs.rancher.com/rancher/faqs/troubleshooting/#agent-logs

I had to move on so lost the agent log in this instance. I just stood up fresh again can see similar conflicts. So rancher-compose up 2 containers, different versions so some shared layers. They wrestle until one succeeds, then eventually the other.
2015-07-19 01:02:43,282 ERROR agent [140097549241552] [event.py:111] 18194f2b-4891-4f08-9d59-acca57095e31 : Unknown error
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 94, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 454, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 516, in _do_instance_activate
    progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 539, in _create_container
    **create_config)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 485, in create_container
    return self.create_container_from_config(config, name)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 493, in create_container_from_config
    return self._result(res, True)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 126, in _result
    self._raise_for_status(response)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 122, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 404 Client Error: Not Found ("could not find image: no such id: 33f4f2e9ec4ff48a93c2b9dcf81282414c4051290647131c5e32e005c5faefdb")
2015-07-19 01:02:45,922 ERROR agent [140097549152080] [event.py:111] 185b0a14-4b4b-41e6-a16b-5ae779e54276 : Unknown error
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 94, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 454, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 516, in _do_instance_activate
    progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 539, in _create_container
    **create_config)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 485, in create_container
    return self.create_container_from_config(config, name)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 493, in create_container_from_config
    return self._result(res, True)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 126, in _result
    self._raise_for_status(response)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 122, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 404 Client Error: Not Found ("could not find image: no such id: 33f4f2e9ec4ff48a93c2b9dcf81282414c4051290647131c5e32e005c5faefdb")
2015-07-19 01:03:00,692 ERROR agent [140097549239952] [event.py:111] b557eb58-fd3b-4e7e-a1b9-c5873aadc4df : Unknown error
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 94, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 454, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 516, in _do_instance_activate
    progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 539, in _create_container
    **create_config)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 485, in create_container
    return self.create_container_from_config(config, name)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 493, in create_container_from_config
    return self._result(res, True)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 126, in _result
    self._raise_for_status(response)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 122, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 404 Client Error: Not Found ("could not find image: no such id: 33f4f2e9ec4ff48a93c2b9dcf81282414c4051290647131c5e32e005c5faefdb")
2015-07-19 01:03:21,964 ERROR agent [140097549150960] [event.py:111] 6c8333fe-186c-47b3-8eec-fa0249d80e57 : Unknown error
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 94, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 454, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 516, in _do_instance_activate
    progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 539, in _create_container
    **create_config)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 485, in create_container
    return self.create_container_from_config(config, name)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 493, in create_container_from_config
    return self._result(res, True)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 126, in _result
    self._raise_for_status(response)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 122, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 404 Client Error: Not Found ("could not find image: no such id: 33f4f2e9ec4ff48a93c2b9dcf81282414c4051290647131c5e32e005c5faefdb")
2015-07-19 01:03:30,770 ERROR agent [140097549150960] [event.py:111] 36254cc4-53a2-4875-9190-f056aad8565e : Unknown error
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 94, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 454, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 516, in _do_instance_activate
    progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 539, in _create_container
    **create_config)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 485, in create_container
    return self.create_container_from_config(config, name)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 493, in create_container_from_config
    return self._result(res, True)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 126, in _result
    self._raise_for_status(response)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 122, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 404 Client Error: Not Found ("could not find image: no such id: 33f4f2e9ec4ff48a93c2b9dcf81282414c4051290647131c5e32e005c5faefdb")
2015-07-19 01:03:45,809 ERROR agent [140097549151760] [event.py:111] df3d60a9-20fd-4587-b32d-a97ca7c44d08 : Unknown error
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 94, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 454, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 516, in _do_instance_activate
    progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 539, in _create_container
    **create_config)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 485, in create_container
    return self.create_container_from_config(config, name)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 493, in create_container_from_config
    return self._result(res, True)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 126, in _result
    self._raise_for_status(response)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 122, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 404 Client Error: Not Found ("could not find image: no such id: 33f4f2e9ec4ff48a93c2b9dcf81282414c4051290647131c5e32e005c5faefdb")
time="2015-07-19T01:04:01Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"062969c8503b96a66e4afb4f875a72cfef2658318c84744cd691c5e245a1a297\", From:\"flaccid/countdown_example:v2\", Time:1437267841}"
time="2015-07-19T01:04:01Z" level="info" msg="Assigning IP [<IP_ADDRESS>/16], ContainerId [062969c8503b96a66e4afb4f875a72cfef2658318c84744cd691c5e245a1a297], Pid [6699]"
time="2015-07-19T01:04:01Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"062969c8503b96a66e4afb4f875a72cfef2658318c84744cd691c5e245a1a297\", From:\"-simulated-\", Time:0}"
time="2015-07-19T01:04:01Z" level="info" msg="Container locked. Can't run StartHandler. ID: [062969c8503b96a66e4afb4f875a72cfef2658318c84744cd691c5e245a1a297]"
time="2015-07-19T01:04:06Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"8caa552a6267f344c2dea11ab2ff84cae1d6453fb1a4cb55073216175482fda4\", From:\"flaccid/countdown_example:v1\", Time:1437267846}"
time="2015-07-19T01:04:06Z" level="info" msg="Assigning IP [<IP_ADDRESS>/16], ContainerId [8caa552a6267f344c2dea11ab2ff84cae1d6453fb1a4cb55073216175482fda4], Pid [7367]"
time="2015-07-19T01:04:06Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"8caa552a6267f344c2dea11ab2ff84cae1d6453fb1a4cb55073216175482fda4\", From:\"-simulated-\", Time:0}"
time="2015-07-19T01:04:06Z" level="info" msg="Container locked. Can't run StartHandler. ID: [8caa552a6267f344c2dea11ab2ff84cae1d6453fb1a4cb55073216175482fda4]"
time="2015-07-19T01:04:09Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"a6365d48eee477e2973877dd3ff59a3e2c9dfe9cad8b90ae4a74ebb20d6d4272\", From:\"rancher/agent-instance:v0.3.1\", Time:1437267849}"
time="2015-07-19T01:04:09Z" level="info" msg="Assigning IP [<IP_ADDRESS>/16], ContainerId [a6365d48eee477e2973877dd3ff59a3e2c9dfe9cad8b90ae4a74ebb20d6d4272], Pid [7718]"
time="2015-07-19T01:04:09Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"a6365d48eee477e2973877dd3ff59a3e2c9dfe9cad8b90ae4a74ebb20d6d4272\", From:\"-simulated-\", Time:0}"
time="2015-07-19T01:04:09Z" level="info" msg="Container locked. Can't run StartHandler. ID: [a6365d48eee477e2973877dd3ff59a3e2c9dfe9cad8b90ae4a74ebb20d6d4272]"

@flaccid What version of rancher/ cattle are you using?

This would be with current release v0.28.0.

@flaccid I haven't been able to produce your setup. Do you have specific images (and the versions) that you could share with me to try? Could you share your docker-compose?

Yep, see if you can reproduce it on Ubuntu 14.04 using https://github.com/flaccid/countdown_example/blob/master/docker-compose.yml and https://github.com/flaccid/countdown_example/blob/master/rancher-compose.yml which use https://registry.hub.docker.com/u/flaccid/countdown_example/. Cheers!

I'm able to reproduce with your setup even though it looks like you removed v1 from your file. :) In my case it ended up crashing rancher agent.
@hibooboo2 Let me know if you want to look at my setup.

Looking at my rancher-agent, here's the docker inspect of my rancher agent.
"State": {
        "Running": false,
        "Paused": false,
        "Restarting": false,
        "OOMKilled": false,
        "Dead": false,
        "Pid": 0,
        "ExitCode": -1,
        "Error": "[8] System error: Unit docker-50be44a13d2dd58ca4318e458dd56b09e1b73c5cf34b8a08479330dd3fdedc6e.scope already exists.",
        "StartedAt": "2015-07-28T18:45:50.961019005Z",
        "FinishedAt": "2015-07-28T18:55:08.775898927Z"
    }

please re-test.

Unable to reproduce with the provided files.


NaN or Inf error

Hello,
My colleagues and I are trying to adapt your ICIM script for our own differential expression project with olfactory epithelium, however, we've been running into quite a few errors and would like some clarification. I was able to run your "ICIM_example" script up until the "Display cells using tSNE" step, where I received the following error raised by the sklearn module:
ValueError: Input contains NaN, infinity or a value too large for dtype('float32').

I am feeding in a counts matrix and metadata file to the "Load Data" step, neither of which contain infinite values. I otherwise have not changed any parameters from the ICIM_example and am not sure why we're getting this error. I've cloned the repo and adjusted the file paths accordingly. Do you have any suggestions for how to get around this? The actual marker gene identification step seems to have been successful, identifying 319 genes. We are incredibly excited to use this script but have been running into problems getting it going!
Thanks so much,

Amanda

You may need to initialize the TSNE object with a df_libs that is indexed by the same names as df or X.