WIP: improve query performance

Opening for feedback. Mainly, what kinds of queries are people having performance problems with?
improvement in this PR is from removing the use of eval. On a database with 450 samples, the worst-case scenario query of:
gemini query -q "select chrom, start, (gts).(*) from variants" \
                        orig.db --gt-filter "(gt_depths).(*).(>=20).(all)

is 3 times faster
A more likely query of:
gemini query -q "select chrom, start, gts.89973, gts.89564, gts.89558, gts.89554, gts.89787 \
                  from variants" orig.db --gt-filter "(gt_depths).(*).(>=20).(all)" > /dev/null

is about 30% faster (I have a low-hanging fruit to improve that).
So, if people can post examples or explanations of queries that are slow, I can optimize for those scenarios.

Very cool!  We will have to give some thought to how to leverage this for the de_novo and auto_* tools, as they currenty build up eval masks based on sample relationships and expected genotypes.  E.g., de_novo:
https://github.com/arq5x/gemini/blob/master/gemini/gemini_subjects.py#L354-L434

Thanks for all this amazing work. It's great to see gemini moving so quickly!
Not sure this is different in any way from your example query above, but I often use gt-filter such as this when working with a tumor(s)/normal database:
"(gt_types).(phenotype==1).(==HOM_REF).(all) and\
 ((gt_types).(phenotype==2).(==HET).(any) or (gt_types).(phenotype==2).(==HOM_ALT).(any)) and\
 (gt_ref_depths).(phenotype==1).(>={min_nrm_ref}).(any) and\
 (gt_alt_depths).(phenotype==2).(>={min_tmr_alt}).(any) and\
 (gt_vafs).(phenotype==1).(<={max_nrm_vaf}).(all) and\
 (gt_vafs).(phenotype==2).(>={min_tmr_vaf}).(any)"

Which is not particularly performant, clearly :)
*gt_vafs is an additional genotype/blob column I added that's useful with tumor samples, e.g. to query variants with sufficiently high VAF in tumor and sufficiently low in normal. It's computed on load as a simple function of the values in gt_depths_ref and gt_depths_alt.
** In some ways, this query is an on the fly version of the set_somatic tool.

With the current set of changes and this query:
gemini query --header -q "select chrom, start, gts.89973, gts.89564, gts.89558, gts.89554, gts.89787\
         from variants" orig.db --gt-filter "((gt_depths).(*).(>=20).(all)) and (gt_types.89973 == HET)"

I get 1.937 secs on this branch vs 4.589 secs on master. I'm out of simple optimizations, but there are a few more things that can be done.
On this branch, I get:
 3015013 function calls (3012594 primitive calls) in 1.937 seconds

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
     4988    0.665    0.000    0.774    0.000 GeminiQuery.py:751(_group_samples_by_genotype)
     4989    0.261    0.000    3.065    0.001 {eval}
      303    0.130    0.000    4.425    0.015 GeminiQuery.py:617(next)
    14964    0.130    0.000    0.130    0.000 {cPickle.loads}
    14964    0.116    0.000    0.116    0.000 {zlib.decompress}
  2301190    0.110    0.000    0.110    0.000 {method 'append' of 'list' objects}
     5379    0.109    0.000    2.782    0.001 {all}
     4989    0.053    0.000    0.131    0.000 GeminiQuery.py:1184(_tokenize_query)
   179585    0.041    0.000    0.066    0.000 GeminiQuery.py:1185(<genexpr>)
   183151    0.038    0.000    0.038    0.000 {method 'split' of 'str' objects}
     4988    0.021    0.000    0.021    0.000 {locals}
    14964    0.014    0.000    0.260    0.000 compression.py:15(unpack_genotype_blob)
     4989    0.013    0.000    0.161    0.000 GeminiQuery.py:1187(_query_needs_genotype_info)

compared to master:
        10272878 function calls (9876368 primitive calls) in 4.589 seconds

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
     4988    1.320    0.000    2.071    0.000 gemini_utils.py:421(partition_by_fn)
  2284504    0.391    0.000    0.391    0.000 GeminiQuery.py:762(<lambda>)
618573/224483    0.287    0.000    0.858    0.000 GeminiQuery.py:1222(flatten)
     6499    0.287    0.000    2.915    0.000 {eval}
    39904    0.278    0.000    0.278    0.000 {zlib.decompress}
    39904    0.267    0.000    0.267    0.000 {cPickle.loads}
  2284504    0.242    0.000    0.242    0.000 GeminiQuery.py:761(<lambda>)
   394094    0.216    0.000    0.369    0.000 abc.py:128(__instancecheck__)
793336/793335    0.203    0.000    0.572    0.000 {isinstance}
      303    0.194    0.001    6.907    0.023 GeminiQuery.py:616(next)
  2301190    0.120    0.000    0.120    0.000 {method 'append' of 'list' objects}
   394114    0.106    0.000    0.106    0.000 _weakrefset.py:70(__contains__)
     5379    0.099    0.000    2.608    0.000 {all}
     4989    0.081    0.000    0.981    0.000 GeminiQuery.py:1192(_tokenize_query)

@rronen thanks for the example. any chance you could share your database?

The data I've been loading lately is under some restrictions, sorry I can't be more helpful on this.

yeah, I realized that was probably the case after posting. We'll get something with a pedigree file internally and I'll use your query as a test-case.

Awesome work brent.  say hi to T and Noor and have a great weekend.
On Mar 20, 2015, at 7:34 PM, Brent Pedersen - Bioinformatics<EMAIL_ADDRESS>wrote:

yeah, I realized that was probably the case after posting. We'll get something with a pedigree file internally and I'll use your query as a test-case.
—
Reply to this email directly or view it on GitHub.

the latest changes get the query above down to 1.53 seconds (from 4.56 originally).
these optimizations should apply to most queries so I think 2X should be common and likely much faster for others. I have yet to look at the pedigree stuff.
 2546591 function calls (2544172 primitive calls) in 1.532 seconds

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
     4988    0.550    0.000    0.655    0.000 GeminiQuery.py:748(_group_samples_by_genotype)
     4989    0.240    0.000    2.918    0.001 {eval}
      303    0.123    0.000    3.906    0.013 GeminiQuery.py:617(next)
  2301190    0.106    0.000    0.106    0.000 {method 'append' of 'list' objects}
     5379    0.101    0.000    2.659    0.000 {all}
    10278    0.094    0.000    0.094    0.000 {cPickle.loads}
    10278    0.094    0.000    0.094    0.000 {zlib.decompress}
    10278    0.010    0.000    0.198    0.000 compression.py:15(unpack_genotype_blob)
     3206    0.010    0.000    0.017    0.000 gemini_subjects.py:30(_set_fields_from_row)
       13    0.008    0.001    0.014    0.001 zipfile.py:803(_RealGetContents)
   346/81    0.006    0.000    0.017    0.000 sre_parse.py:388(_parse)
        4    0.005    0.001    0.015    0.004 gemini_utils.py:26(<dictcomp>)

@rronen
you could run: python -m cProfile -s tottime /full/path/to/gemini .... args ...
with your query and paste the first 30 lines of profiling output.

Hi @brentp,
Sorry this took so long, I was a little swamped with other things. The output below is from running the profiler for a python program that calls GeminiQuery via the python api with a query like the one I mentioned above. It's a very tough query (worst case in many ways) as it's genotype fields only and thus no use of any index.
Here are the first 30 lines (database used here has ~75k entries from two tumor exomes and a matched normal exome).
28492267 function calls (24946142 primitive calls) in 79.641 seconds

Ordered by: internal time

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
5600111/2056073   15.641    0.000   44.846    0.000 GeminiQuery.py:1115(flatten)
    27063   13.867    0.001   16.477    0.001 {eval}
7101815/7101814   10.898    0.000   29.221    0.000 {isinstance}
  3544039   10.819    0.000   18.323    0.000 abc.py:128(__instancecheck__)
      835    4.595    0.006   80.856    0.097 GeminiQuery.py:515(next)
  3544067    4.492    0.000    4.492    0.000 _weakrefset.py:70(__contains__)
    27053    3.571    0.000   50.047    0.002 GeminiQuery.py:1085(_tokenize_query)
  3548074    3.016    0.000    3.016    0.000 {getattr}
   243468    2.725    0.000    2.725    0.000 {cPickle.loads}
    27053    2.092    0.000   53.970    0.002 GeminiQuery.py:1089(_query_needs_genotype_info)
  2059182    1.830    0.000    1.830    0.000 {method 'startswith' of 'str' objects}
  1542628    1.630    0.000    1.630    0.000 {method 'split' of 'str' objects}
   243468    1.138    0.000    5.365    0.000 compression.py:16(unpack_genotype_blob)
   243468    0.934    0.000    0.934    0.000 {zlib.decompress}
   245600    0.572    0.000    0.572    0.000 {numpy.core.multiarray.array}
    81563    0.277    0.000    1.212    0.000 {all}
    77166    0.227    0.000    0.845    0.000 {any}
    27056    0.178    0.000    0.178    0.000 {locals}
      205    0.087    0.000    0.254    0.001 doccer.py:12(docformat)
    27079    0.078    0.000    0.115    0.000 {map}
    70067    0.056    0.000    0.056    0.000 {method 'append' of 'list' objects}
        1    0.055    0.055    0.075    0.075 qt4_compat.py:2(<module>)

Let me know if you need anything else!

thanks @rronen .
I've optimized a lot of those slow points at the top of your list. I just tried a similar query
(gt_types).(phenotype == 1).(==HOM_REF).(all) and \
   ((gt_types).(phenotype==2).(==HET).(any) \
     or (gt_types).(phenotype==2).(==HOM_ALT).(any)) and \
  (gt_ref_depths).(phenotype==1).(>=20).(any) and \
  (gt_alt_depths).(phenotype==2).(>=20).(any)

and get 74 seconds on master vs. 13.8 seconds with identical md5sums on the output, so I think you'll have at least 3X improvement.
For that query, I don't see much room left for improvement without splitting the eval:
         666181 function calls (664016 primitive calls) in 13.810 seconds

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
    29866    7.837    0.000   10.101    0.000 {eval}
    89935    1.739    0.000    1.739    0.000 {cPickle.loads}
      341    1.641    0.005   15.003    0.044 GeminiQuery.py:613(next)
    89935    0.522    0.000    0.522    0.000 {zlib.decompress}
    89935    0.441    0.000    2.701    0.000 compression.py:15(unpack_genotype_blob)
    29865    0.378    0.000    0.462    0.000 GeminiQuery.py:745(_group_samples_by_genotype)
    77782    0.297    0.000    0.982    0.000 {any}
    30284    0.159    0.000    0.606    0.000 {all}
    71762    0.097    0.000    0.097    0.000 {method 'append' of 'list' objects}

so I'm going to add tests so this will be ready to merge.

Thanks @brentp!! Looking forward to trying the new version!

Very excited about this PR.


fix/Inconsistent run_results production

Description & motivation

Inconsistency on the overview page and the run_results page; dbt compile does create run_results.json
To-do before merge

Prerelease docs
If this change is related to functionality in a prerelease version of dbt (delete if not applicable):

[ ] I've added versioning components, as described in "Versioning Docs"
[ ] I've added a note to the prerelease version's Migration Guide

Checklist
If you added new pages (delete if not applicable):

[ ] The page has been added to website/sidebars.js
[ ] The new page has a unique filename

If you removed existing pages (delete if not applicable):

[ ] The page has been removed from website/sidebars.js
[ ] An entry has been added to _redirects
[ ] Run link testing to update the links that point to the deleted page

Thanks for opening this PR and contributing to the dbt Labs product docs, @cris-seaton !
I checked your change and looks like "compile" was added to that sentence in PR #2057 . Closing this PR. Please feel free to reopen if something wasn't addressed.


Skip reformatting and calling onChanged for composing region only changes.

Description
If a text input formatter keeps rejecting changes made by the IME, and the IME keeps rejecting changes made by the input formatter, then an infinite loop will ensue.  https://github.com/flutter/flutter/pull/66864 made it so that input formatters are reapplied whenever the composing region changes. It turns out Gboard always tries to restore the composing region by calling setComposingRegion when the composing region is modified programmatically. If an input formatter removes the composing region, Gboard will try adding it back.
Stop formatting or calling onChanged on composing region only changes seems to fix the problem for Gboard (unless the developer tries to do this from within a TextEditingController's listener), for now.
Related Issues
Replace this paragraph with a list of issues related to this PR from our issue database. Indicate, which of these issues are resolved or fixed by this PR. There should be at least one issue listed here.
Tests
I added the following tests:
Replace this with a list of the tests that you added as part of this PR. A change in behavior with no test covering it
will likely get reverted accidentally sooner or later. PRs must include tests for all changed/updated/fixed behaviors. See Test Coverage.
Checklist
Before you create this PR, confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]). This will ensure a smooth and quick review process.

[ ] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[ ] I signed the CLA.
[ ] I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
[ ] I read the Tree Hygiene wiki page, which explains my responsibilities.
[ ] I updated/added relevant documentation (doc comments with ///).
[ ] All existing and new tests are passing.
[ ] The analyzer (flutter analyze --flutter-repo) does not report any problems on my PR.
[ ] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Did any tests fail when you ran them? Please read Handling breaking changes.

[ ] No, no existing tests failed, so this is not a breaking change.

I was playing with text formatters on master and this bug is very easy to reproduce.


How to change the mimeType in the Tone.Recorder?

There is an option of mimeType in Tone.Recorder but when I change it as follows:
recorder = new Tone.Recorder({ mimeType: 'audio/ogg; codecs=opus' });
so I get the error like this:
"core.js:6456 ERROR Error: Uncaught (in promise): NotSupportedError: Failed to construct 'MediaRecorder': Failed to initialize native MediaRecorder the type provided (audio/ogg; codecs=opus) is not supported."
It's looks like the Tone.Recorder only suports "webm" mimeType as default.
How to change it?
Thanks

Tone.Recorder is a very thin wrapper around the MediaRecorder API so it can only support the mime types that the browser supports.
You can check which formats your browser supports using:
MediaRecorder.isTypeSupported('audio/ogg; codecs=opus')

On Chrome this currently produces false.  But looks like opus encoding of a webm wrapper does work: MediaRecorder.isTypeSupported("audio/webm\;codecs=opus")

Thank you for you reply;
Yes it's correct, I have already seen that chrome browser doesn't support OGG but when I use the MediaRecorder API like an example which I saw on the Codepen, it looks like works correctly.
example link is as follows:
https://codepen.io/jakealbaugh/pen/QVqgBE/?editors=1111
So it can be save the audio files as OGG or Wav with this solution but I don't know the saved file is a real OGG or not.


Integration builds takes lots of time

Platform: minikube 1.6.2
camel-k: 1.0.0.RC1
The camel-k integration builds takes lots of time to complete ~ 12 mins and i see its struck in a particular place for long  as shown in the log below ( not sure its Kankio issue)
camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0492] Downloading base image <IP_ADDRESS>/chapter-7/camel-k-kit-bofj39ei1aal47gim830:36212
camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Skipping unpacking as no commands require it.
camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Taking snapshot of full filesystem...
camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Using files from context: [/builder/kit-bofk6gui1aal47gim840/package/context]
camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] ADD . /deployments
camel-k-kit-bofk6gui1aal47gim840-builder kaniko INFO[0647] Taking snapshot of files...

Is there a way to optimize this ? As majority of developers will be on minikube we need to make sure its faster and quicker there.

It should be fixed with #1256.


scribble.scale is case sensitive

Initially scribbletune denoted accidentals - the sharp (♯) and flat (♭) notes as sharps by default. Recently the functionality was added to make flats (♭) as the default way to denote accidentals with provision to still recognize them if sharps were passed to the methods. However scribble.scale  also referenced as scribble.mode doesn't recognize this change unless the arguments are all lower case.
For instance scribble.mode('db', 'major') returns [ 'db4', 'eb4', 'f4', 'gb4', 'ab4', 'bb4', 'c5', 'db5' ] but scribble.mode('Db', 'major') returns [ 'b5', 'Db5' ] and scribble.mode('db', 'Major') just throws an error as it cannot recognize Major (it expects major)
Tests that correctly returns notes for scribble.mode('Db', 'major'); and  scribble.mode('Db', 'Major'); are required to be added.

Fixed in 7c8c3ba


Added Memory.md section on safety

cc @davidfowl, @jkotas, @benaadams, @jaredpar, @joshfree, @botaberg, @vancem, @AtsushiKan

See how reference counting helps with outstanding Memory; but not sure how reference counting helps with outstanding Spans?
Span has no Dispose and it would need some kind of "out of scope" destructor addition to the runtime?

The point is that we can detect and fail with an error if OwnedMemory is Disposed while ref count is > 0.

Ah; looked at the code that's pretty horrible 😁
Also isn't greatly safe
var reservation = memory.AddReference();
var span = reservation.Span;
reservation.Dispose();
// trouble, no tooled compile warning about not disposing
var item = span[0];

Memory and its functions can be protected; but don't think there is much that can be done about Span itself

Right, there would need to be C# language support to make this look reasonable and to make the use after free patterns prohibited.


wrap the note about rabbit in a note

helps make it clear where the sidenote ends

not sure why this is still marked as failing in gh, looks fine to me in travis


Add latexrun default directory for auxiliary files

Reasons for making this change:
Add the default directory where latexrun outputs all intermediate files.
Also add a new section for possible future latex build tools using similar mechanisms.
Links to documentation supporting these rule changes:
The author haven't documented this, or at least I couldn't find it.
Below is the line that specifies this default build path
https://github.com/aclements/latexrun/blob/38ff6ec2815654513c91f64bdf2a5760c85da26e/latexrun#L90

@eelregit thanks!


fs dependency was not found

I install your package (npm version 5.6.0 and node version 8.11.1)
and get an error:
`This dependency was not found:

fs in ./~/exceljs/dist/es5/xlsx/xlsx.js, ./~/exceljs/dist/es5/utils/utils.js and 24 others`.

How solve this problem?

@sapfiris I'm not sure how you are getting this error - "fs" is an inbuilt module in nodejs and not required as a dependency. Can you show more output?

I'm encountering the same error. Using Node 8.14 and typescript 2.4.  I'm using this lib on top of SharepointFx.
I'm only interested in the browser component, hence only imported that.
import ExcelJS from "exceljs/dist/es5/exceljs.browser";

function generateExcel() {
  var wb = new ExcelJS.Workbook(); // commenting this line out lets me lead the page successfully
}

I'm encountering the same error. Using Node 8.14 and typescript 2.4. I'm using this lib on top of SharepointFx.
I'm only interested in the browser component, hence only imported that.
import ExcelJS from "exceljs/dist/es5/exceljs.browser";

function generateExcel() {
  var wb = new ExcelJS.Workbook(); // commenting this line out lets me lead the page successfully
}

How did you get the type definitions for the browser? Did you generate your own .d.ts file?

@ahouck I honestly can't remember

I seem to be stuck at the same point about getting type definitions for the browser - any leads would be helpful!


Doesn't work with UUID foreign key types

Hi,
The models I need to track (trackable, owner, etc.) all use UUID keys in Postgres. I'm using ActiveRecord. With most ActiveRecord plugins, changing the migration so that the foreign keys are UUID is sufficient. But with public_activity, this doesn't seem to work. The queries generated are setting trackable_id to some int, and then Postgres complains that it's not a UUID.
Is there any support for UUID foreign keys in public_activity? Thanks!

Hi @xtagon! That is interesting, nothing that might prevent it comes to my mind right now but will investigate!

@xtagon are your trackable_id, owner_id, etc fields set to be type: :uuid?
  t.belongs_to :trackable, polymorphic: true, type: :uuid
  t.belongs_to :owner, polymorphic: true, type: :uuid

@bytheway875 Yes they were. I made that change to the migration before running it. Postgres expects a UUID in the query but the plugin is generating queries with an integer in place of the UUID.
Unfortunately, since I could not resolve this in time for the project I'm working on, I've moved on to rolling my own tracking solution for now. This is still a good issue to address, but just know that the priority is not high for me anymore since I had to move on. I'll still do what I can to help figure it out, of course. Thanks!

+1, going to give it a shot now

+1, is there any solution to this?

It worked for me setting up the migration to use uuids (I had forgot to do that before), thanks!

Yeah you have to change the migration PublicActivity generates as it doesn't use UUID by default.

Closing as resolved

I lost a half hour to this same issue. The problem was that I had changed and rerun the migration but I hadn't restarted the server.


Browserslist: caniuse-lite is outdated. Please run next command npm update caniuse-lite browserslist

We recently started seeing this message on meteor run / meteor build

Browserslist: caniuse-lite is outdated. Please run next command npm update caniuse-lite browserslist

Would bumping autoprefixer solve the issue ?
(latest is 9.5.0, meteor-minifiers-autoprefix uses 7.0.5)

This is the nature of packages that have NPM dependencies. npm-shrinkwrap.json causes the exact versions to be installed and nothing more.
I'll see about getting a PR submitted for this.

bump ?

Just released version 2.0.0 which updates dependencies and should have some performance improvements as well.

Awesome :tada:
Thanks @sebakerckhof !


binary tree post order traversal in java

Have you read the Contributing Guidelines on Pull Requests?
Yes
Description
added the code for post order traversal in binary tree
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[ ] I've edited the README.md and link to my code.

Related Issues or Pull Requests
#415

Thanks for requesting changes i had done the changes and make a new pull request #484 please review that pull request with the changes made.

maked a new pr #484


The link for sharing the network weights is invalid. Could the author please share it again?

The link for sharing the network weights is invalid. Could the author please share it again?

The link for sharing the network weights is invalid. Could the author please share it again?

Hi myzyuzhoumu,
The google drive link for network weights is correct. I am able to download the weights without issue. Here, are the weights.
Can you share the error message or screeshot?
https://github.com/Arka-Bhowmik/mri_triage_normal/tree/main/output


Add Boost Python bindings

What does this PR do?
Add Boost Python bindings
Closes
closes #370

run ./scripts/generate.sh to generate and build the (broken) Python bindings.
I think I need some help.

Broken bindings fixed with help from:
https://stackoverflow.com/questions/50180219/why-is-boost-python-trying-to-instantiate-an-abstract-type
Shape::is_equal is currently not generating bindings that compile so I've restricted the template to consider only properties.
I've added a build target and crude test to CMake.
Library link commands are not quite there (missing boost-python).
See: https://gitlab.kitware.com/cmake/cmake/issues/16391
Off to see friends and family for the long weekend.

This all looks fine to me.


Site outage

https://papertrailapp.com/systems/ip-172-30-2-151/events?focus=1035367826968031293&selected=1035367826968031293
Unsure what caused it. Had just manually built a cppx compiler but that seems coincidental.

Feb 21 16:28:08 ip-172-30-2-151 unified: info: 2620:10d:c090:200:0:0:0 "POST /api/popularArguments/vcpp_v19_16_x64" 200
Feb 21 16:28:09 ip-172-30-2-151 unified: info: <IP_ADDRESS> "POST /api/compiler/g82/compile" 200
Feb 21 16:29:08 ip-172-30-2-151 all.err: 2019/02/21 22:29:08 [error] 6#6: *536813 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/clang600/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/clang600/compile", host: "godbolt.org"
Feb 21 16:29:08 ip-172-30-2-151 all.err: 2019/02/21 22:29:08 [error] 6#6: *536358 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/clang500/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/clang500/compile", host: "godbolt.org"
Feb 21 16:29:10 ip-172-30-2-151 all.err: 2019/02/21 22:29:10 [error] 6#6: *536803 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/g82/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/g82/compile", host: "gcc.godbolt.org"
Feb 21 16:29:10 ip-172-30-2-151 all.err: 2019/02/21 22:29:10 [error] 6#6: *536054 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/clang700/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/clang700/compile", host: "godbolt.org"

Even after a restart, seeing:
Feb 21 16:34:01 ip-172-30-1-175 all.err: 2019/02/21 22:34:01 [error] 6#6: *64 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"

logged onto a node, it's still starting up.

ok...it's coming back online. Will need a proper postmortem :/

Searched all the logs for this seemingly characteristic "Connection timed out" from nginx talking to the site.
We see occasional mentions of it going back to Feb 16th (logs go back to Feb 14th). One such episode starts on Feb 16T10:31 and we see a page or two of timeouts from nginx, followed by apparent recovery (many failures elided):
...
Feb 16 10:32:19 ip-172-30-2-151 all.err:  2019/02/16 16:32:19 [error] 6#6: *65494 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/cg82/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/cg82/compile", host: "godbolt.org"
Feb 16 10:32:21 ip-172-30-2-151 all.err:  2019/02/16 16:32:21 [error] 6#6: *65496 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/g82/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/g82/compile", host: "godbolt.org"
Feb 16 10:32:22 ip-172-30-2-151 unified:  warn: Timeout for /compiler-explorer/c-preload/compiler-wrapper [ '/opt/compiler-explorer/gcc-8.2.0/bin/g++',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-g',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-o',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '/tmp/compiler-explorer-compiler119116-53-v3ndz7.s1mi/output.s',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-fdiagnostics-color=always',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-m32',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '/tmp/compiler-explorer-compiler119116-53-v3ndz7.s1mi/example.cpp' ] after 20000 ms
Feb 16 10:32:22 ip-172-30-2-151 unified:  warn: Timeout for /compiler-explorer/c-preload/compiler-wrapper [ '/opt/compiler-explorer/intel/xe_2016_update3/bin/icc',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-g',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-o',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '/tmp/compiler-explorer-compiler119116-53-mqvjgz.ija9/output.s',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-masm=intel',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-S',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-x',
Feb 16 10:32:22 ip-172-30-2-151 unified:    'c',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-gcc-name=/opt/compiler-explorer/gcc-4.6.4/bin/gcc',
Feb 16 10:32:22 ip-172-30-2-151 unified:    '-std=c99',
Feb 16 10:32:22 ip-172-30-2-151 unified:   '-std=c99',
Feb 16 10:32:22 ip-172-30-2-151 unified:   '-Ofast',
Feb 16 10:32:22 ip-172-30-2-151 unified:   '-xAVX',
Feb 16 10:32:22 ip-172-30-2-151 unified:   '/tmp/compiler-explorer-compiler119116-53-mqvjgz.ija9/example.c' ] after 20000 ms
Feb 16 10:32:22 ip-172-30-2-151 unified: warn: Skipping temporary file clean up as compiler environment is busy
Feb 16 10:32:22 ip-172-30-2-151 unified: info: 2a02:c7f:4a01:aa00:a470:0:0:0 "POST /api/compiler/cicc16/compile" -

This looks for all the world like a compiler execution or two somehow "gummed up" the works, OR that the process went into total pause for a long time (in which the compilers timed out too as well as the nginx attempts).
Anoyther epise (different host) happened at Feb 18 01:49. This one did not exhibit the "timeout compiler" but did recover:
Feb 18 01:51:11 ip-172-30-5-232 all.err: 2019/02/18 07:51:10 [error] 6#6: *130237 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 18 01:51:12 ip-172-30-5-232 all.err: 2019/02/18 07:51:12 [error] 6#6: *130239 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 18 01:51:13 ip-172-30-5-232 all.err: 2019/02/18 07:51:13 [error] 6#6: *130241 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 18 01:51:15 ip-172-30-5-232 unified: info: <IP_ADDRESS> "POST /api/compiler/cg82/compile" 200
Feb 18 01:51:15 ip-172-30-5-232 unified: info: <IP_ADDRESS> "POST /api/popularArguments/cg82" 200
Feb 18 01:51:15 ip-172-30-5-232 unified: info: <IP_ADDRESS> "POST /api/popularArguments/g82" 200

Another episode was a one-off, with a single compiler timeout:
Feb 18 14:23:21 ip-172-30-4-199 unified:  info: 2001:982:8a4c:1:878:0:0:0 "GET /z/wjtYvB" 200
Feb 18 14:23:21 ip-172-30-4-199 unified:  info: <IP_ADDRESS> "POST /api/compiler/g82/compile" 200
Feb 18 14:24:04 ip-172-30-4-199 all.err:  2019/02/18 20:24:04 [error] 6#6: *2154 upstream timed out (110: Connection timed out) while reading response header from upstream, client: <IP_ADDRESS>, server: , request: "POST /api/compiler/clang600/compile HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/api/compiler/clang600/compile", host: "godbolt.org"
Feb 18 14:24:04 ip-172-30-4-199 unified:  warn: Timeout for /compiler-explorer/c-preload/compiler-wrapper [ '/opt/compiler-explorer/gcc-8.2.0/bin/g++',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-g',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-o',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '/tmp/compiler-explorer-compiler119118-53-1f8xmg4.zsfm/output.s',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-masm=intel',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-S',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-fdiagnostics-color=always',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '/tmp/compiler-explorer-compiler119118-53-1f8xmg4.zsfm/example.cpp' ] after 20000 ms
Feb 18 14:24:04 ip-172-30-4-199 unified:  warn: Timeout for /compiler-explorer/c-preload/compiler-wrapper [ '/opt/compiler-explorer/gcc-7.3.0/bin/gcc',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-g',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-o',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '/tmp/compiler-explorer-compiler119118-53-heoozu.pyoe9/output.s',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-masm=intel',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-S',
Feb 18 14:24:04 ip-172-30-4-199 unified:    '-fdiagnostics-color=always',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '/tmp/compiler-explorer-compiler119118-53-heoozu.pyoe9/example.c' ] after 20000 ms
Feb 18 14:24:05 ip-172-30-4-199 unified:  warn: Timeout for /compiler-explorer/c-preload/compiler-wrapper [ '/opt/compiler-explorer/gcc-8.2.0/bin/g++',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '-g',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '-o',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '/tmp/compiler-explorer-compiler119118-53-6a0q0o.s1125/output.s',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '-fdiagnostics-color=always',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '-O0',
Feb 18 14:24:05 ip-172-30-4-199 unified:    '/tmp/compiler-explorer-compiler119118-53-6a0q0o.s1125/example.cpp' ] after 20000 ms
Feb 18 14:24:05 ip-172-30-4-199 unified:  info: <IP_ADDRESS> "POST /api/compiler/clang600/compile" 200
Feb 18 14:24:05 ip-172-30-4-199 unified:  info: <IP_ADDRESS> "POST /api/popularArguments/g82" 200

Finally, today's failure seemed like just a fail-and-never-come-back, for one host. Why our spot instances didn't pick up the slack is another mystery.

Interestingly there's a gap at this time in the CloudFront monitoring logs, as if the host itself was wedged between 16:25 and 16:35.
Offending instance seems to have been  i-081d2e50def4ad5e1, if that helps diagnosis.

https://console.aws.amazon.com/cloudwatch/home?region=us-east-1#metricsV2:graph=~(view~'timeSeries~stacked~false~metrics~(~(~'AWS*2fEC2~'StatusCheckFailed_System~'InstanceId~'i-081d2e50def4ad5e1)~(~'.~'StatusCheckFailed~'.~'.)~(~'.~'StatusCheckFailed_Instance~'.~'.)~(~'.~'CPUSurplusCreditBalance~'.~'.)~(~'.~'CPUCreditUsage~'.~'.)~(~'.~'CPUCreditBalance~'.~'.)~(~'.~'CPUSurplusCreditsCharged~'.~'.)~(~'.~'DiskWriteOps~'.~'.)~(~'.~'DiskReadBytes~'.~'.)~(~'.~'DiskWriteBytes~'.~'.)~(~'.~'CPUUtilization~'.~'.)~(~'.~'DiskReadOps~'.~'.)~(~'.~'NetworkPacketsOut~'.~'.)~(~'.~'NetworkOut~'.~'.)~(~'.~'NetworkIn~'.~'.)~(~'.~'NetworkPacketsIn~'.~'.)~(~'.~'EBSWriteOps~'.~'.)~(~'.~'EBSWriteBytes~'.~'.)~(~'.~'EBSByteBalance*25~'.~'.)~(~'.~'EBSReadOps~'.~'.)~(~'.~'EBSReadBytes~'.~'.)~(~'.~'EBSIOBalance*25~'.~'.))~region~'us-east-1~start~'2019-02-21T223a073a00.233Z~end~'2019-02-21T223a283a00.782Z);search=~'20i-081d2e50def4ad5e1;namespace=~'AWS2fEC2;dimensions=~'InstanceId graphs all the stats we have for that instance. Maybe there's no hole in CPU reporting after all.

If one just looks at CPU usage, it was climbing just before the node was killed.
NetworkIn was pretty high, but only 84MB.
EBS looks nominal.

Just happened during startup:
Feb 22 14:05:14 ip-172-30-1-232 unified:  info: Gathering gnuas73 version information on /opt/compiler-explorer/gcc-7.3.0/bin/as
Feb 22 14:05:14 ip-172-30-1-232 unified:  info: Gathering gnuas81 version information on /opt/compiler-explorer/gcc-8.1.0/bin/as
Feb 22 14:05:14 ip-172-30-1-232 unified:  info: Gathering gnuassnapshot version information on /opt/compiler-explorer/gcc-snapshot/bin/as
Feb 22 14:05:14 ip-172-30-1-232 all.err:  2019/02/22 20:05:14 [error] 6#6: *1 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 22 14:05:14 ip-172-30-1-232 all.err:  2019/02/22 20:05:14 [error] 6#6: *3 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 22 14:05:14 ip-172-30-1-232 all.err:  2019/02/22 20:05:14 [error] 6#6: *5 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 22 14:05:14 ip-172-30-1-232 all.err:  2019/02/22 20:05:14 [error] 6#6: *7 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 22 14:05:14 ip-172-30-1-232 all.err:  2019/02/22 20:05:14 [error] 6#6: *7 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 22 14:05:14 ip-172-30-1-232 all.err:  2019/02/22 20:05:14 [error] 6#6: *9 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: , request: "GET /healthcheck HTTP/1.1", upstream: "http://<IP_ADDRESS>:10240/healthcheck", host: "<IP_ADDRESS>"
Feb 22 14:05:14 ip-172-30-1-232 unified:  info: Gathering llvmas30 version information on /opt/compiler-explorer/clang+llvm-3.0-x86_64-linux-Ubuntu-11_10/bin/llvm-mc

maybe we've hit a point of taking so long to start the healthchecks are failing during startup. That's not dreadful in itself, and seems unrelated to the other problem seen.

Closing as this appears to have "fixed" itself :/


Perf capture 2

part of #20071
extracted from #22175
these changes do not really change the way that this works.
There is a performance fix for VimPerformanceState lookups.

ms
bytes
objects
query
qry ms
rows
comments

68,193.4
111,910,078*
142,632,619
3,831
24,301.8
753
capture-orig-1

67,496.0
142,311,223*
143,119,291
2,995
22,937.5
335
capture-rollup-1

There is are more comments in that particular commit. But the high level is when creating a new VimPerformanceState, it no longer queries for the latest state.

update:

fixed test
fixed cop for case and closing paren.

update:

moved historical_start/end to the gap processing

update:

changed code around historical gap for fewer changed lines (same code just moved fewer lines)

update:

cops

update:

added comments in fix_perf_capture_start_end_time

update:

put limiter for realtime on the past 4 hours

Ignoring 3 perf_process rubocops:
This PR is already making enough changes.
update:

VimPerformanceState#capture now supports multiple objects
metrics perf_process cutup into multiple methods

@Fryguy @agrare any last requests on this one?
I did make review changes requested by @agrare and feel this PR has stabilized.
change ref: https://github.com/ManageIQ/manageiq/pull/22199#issuecomment-1294306165


for issue#591, Updated privacy.html

Issues Identification
Closes: #(591)
Description
Summary
Major changes in privacy policy page to make it like more genuine and professional.
Details
Written all the regarding terms of policy like collecting user info, security of user data, sharing of user info etc.
Types of Changes
Please check the boxes that apply

[x] New feature (non-breaking change that adds functionality)
[x] Other (updated privacy policy.html):

Checklist
Please check the boxes that apply

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] My changes generate no new warnings
[x] My changes do not break the current system and pass all existing test cases
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

This is how the page looks like now

Please provide any other information that is relevant to this pull request.

@anadisharma121 now it is coming.
I am merging this.

@vivekvardhan2810 please assign labels so that I can't miss my points.


2020 upgrade

initial draft for 2020 upgrade, need to add 2020 specific details

I have sent and update in your branch. After you merge the changes, you have my approval to complete this PR.


Hash and prune copied CSVs in olm-operator.

OLM doesn't need to maintain a local cache of complete copied
ClusterServiceVersion objects because it also holds the source of
truth.

/hold
Will need a rebase once https://github.com/operator-framework/operator-lifecycle-manager/pull/2282 merges -- that dependency bump fixes a bug in client-go/testing that affects this change.

/hold cancel


Modify V2 API response to be always Json

Codecov Report

Merging #978 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #978   +/-   ##
=======================================
  Coverage   28.31%   28.31%
=======================================
  Files         158      158
  Lines        4524     4524
  Branches     1153     1153
=======================================
  Hits         1281     1281
  Misses       3243     3243

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 782b125...b57c37d. Read the comment docs.

Coverage remained the same at 27.651% when pulling b57c37d97ed7a2e20446af4ba7e05cba5e143edc on alyiwang:fe into 782b125884e3241d05a5736285b9a5fcb41a7709 on linkedin:master.


H.redirect always refresh page

I have a code that use gsap scroll trigger to call the H.redirect() when scroll to that element. But instead of transitioning the page, it hard redirect to the destination page.
... ScrollTrigger.create({ ... onEnter: () => { H.redirect('dest', 'myTransitionKey') } ... })

I ran into the same problem - it's related to this line  where it compares location.origin of the passed in url vs the url of the current page.
It can be fixed by explicitly passing the origin like:
... ScrollTrigger.create({ ... onEnter: () => { H.redirect(`${window.location.origin}/dest`, 'myTransitionKey') } ... })


Photon and Glitch

This is an awesome example of using Photon with Glitch: https://glitch.com/~prisma2-graphql
However, this example requires SQLite path to be absolute. Glitch does remixing on projects which is where they are copied over from one location to another.
While generating Photon though, we translate relative path with some depth (need to find the reason of why this is happening, hence, the needs-info label):

Note: Glitch recommends storing data in .data directory.
Moreover, we can occasionally see that Glitch fails to copy over the Prisma binary when it is executing (and hence busy):
  Error: ETXTBSY: text file is busy, copyfile '/rbd/pnpm-volume/43b751fb-77ef-4b35-9fb6-d4b1e5d57086/node_modules/prisma2/query-engine-linux-glibc-libssl1.0.2-ubuntu1604' -> '/app/node_modules/@generated/photon
/runtime/query-engine-linux-glibc-libssl1.0.2-ubuntu1604'

My glitch experiment: https://glitch.com/edit/#!/nine-trick?path=server.js:10:33

Closing this in favor of https://github.com/prisma/prisma2/issues/1209
We still need to understand more about the "ETXTBSY" error, but this specific issue has nothing to do with Glitch.


[fix]修改文案

Codecov Report

Merging #574 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #574   +/-   ##
=========================================
  Coverage     79.74%   79.74%
  Complexity      201      201
=========================================
  Files            39       39
  Lines           617      617
  Branches         58       58
=========================================
  Hits            492      492
  Misses          101      101
  Partials         24       24

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c585d2d...30f1d0a. Read the comment docs.


cargo concordium init does not work if non-empty concordium-contracts-common folder exists

Bug Description
cargo concordium init does not work if non-empty concordium-contracts-common folder exists.
Steps to Reproduce

Create a non-empty folder named concordium-contracts-common: mkdir concordium-contracts-common; touch concordium-contracts-common/a.txt
Run cargo concordium init

Expected Result
The wizard starts correctly:
❯ cargo concordium init
? 🤷   Which template should be expanded? ›
❯ cis2-nft
  default

Actual Result
The wizard cannot run:
❯ cargo concordium init
Error: Please check if the Git user / repository exists.

Caused by:
    'concordium-contracts-common' exists and is not an empty directory; class=Invalid (3); code=Exists (-4)
Error: Could not create a new Concordium smart contract project.

Caused by:
    Could not use the template to initialize the project.

Versions

Software Version: cargo concordium 2.5.0
OS: macOS

This is fundamentally a bug in cargo generate and further it is actually a bug in its dependency (https://github.com/libgit2/libgit2/issues/5830)
I have reported a bug to cargo-generate with a suggested workaround https://github.com/cargo-generate/cargo-generate/issues/839


The property's value of default Access Tier doesn't auto change

Storage Explorer Version: 1.1.0 RC
Platform: Windows/Linux/Mac
Architecture: ia32/x64
Build Number: 20180507.1
Commit: bcc8990d
Regression From: Not a regression
Steps to Reproduce:

Launch Storage Explorer and expand a blob account.

Right click the account and set the default Access Tier to 'Cool'.

Check the value of default Access Tier in Properties Panel.

Expected Experience:

The value of default Access Tier auto change to 'Cool'.
Actual Experience:

The value of default Access Tier still displays as 'Hot'.

Let's:

Update wording/icon in the activity to make what's going on more clear
Think about polling for Default Access Tier, but probably not

Verified this issue on the latest build 20190614.7. It still reproduces. Could you help to take a look?

@v-xianya does this still reproduce on latest builds from main? :P

@MRayermannMSFT  This issue still reproduces on build main/20201020.3.  （The Default access tier updated after manually refreshing the account node）

Verified this issue on build 20201116.2. Fixed.


where do i get the linux server from

where do i get the linux server from

You can get one from https://blazingfast.io/ or a similar VPS provider.


Switched to using groovy scripts to initialize

Exiting method fails because jenkins automatically deletes the
update file
With a groovy script we're using internal jenkins calls which
should be more future-proof

This should also address #312 without having to mess with regex

This should also address #312 without having to mess with regex

Looks like CI is failing because the created instance is not allowing access to the ansible jenkins_script module. Unfortunately I cannot address that.

Looks like CI is failing because the created instance is not allowing access to the ansible jenkins_script module. Unfortunately I cannot address that.


Can't install nuget package

I have a new console application on which I'm trying to install Topshelf from Nuget. I always get the following error:
PM> Install-Package Topshelf
Installing 'Topshelf 4.0.1'.
Successfully installed 'Topshelf 4.0.1'.
Adding 'Topshelf 4.0.1' to FileConverterService.
Uninstalling 'Topshelf 4.0.1'.
Successfully uninstalled 'Topshelf 4.0.1'.
Install failed. Rolling back...
Install-Package : Could not install package 'Topshelf 4.0.1'. You are trying to install this package into a project that targets '.NETFramework,Version=v4.5.1', but the package
does not contain any assembly references or content files that are compatible with that framework. For more information, contact the package author.
At line:1 char:1
+ Install-Package Topshelf
+ ~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [Install-Package], InvalidOperationException
    + FullyQualifiedErrorId : NuGetCmdletUnhandledException,NuGet.PowerShell.Commands.InstallPackageCommand

I've tried using .NET 2.0, 3.5, 4.0, 4.5 and 4.5.1 and I always get the same error. Why can't it find binaries for any .NET version?

.NET v.4.5.1 is not supported any longer, use 4.5.2+.

Install-Package Topshelf -version 3.3.1
is useful!

3.3.1 Topshelf version worked perfectly alright with 4.5.1 Framework

Even I faced Same Issue Please Install .Net Framwork 4.5.2 ,It will Work .


Can not create RDS instance with identifierPrefix. "ConflictsWith" error

Getting an error creating the following instance
const rdsInstance = new aws.rds.Instance(
      `${env}-postgres`,
      {
        identifierPrefix: `${serviceName}-${env}-`,
        engine: 'postgres',
        engineVersion: rdsConfig.get('version') || '9.6.11',
        instanceClass: rdsConfig.get('instanceType') || aws.rds.InstanceType.T3_Micro,
        allocatedStorage: 100,
        storageType: aws.rds.StorageTypes.GP2,
        storageEncrypted: true,
        snapshotIdentifier: rdsConfig.get('baseSnapshot'),
        backupRetentionPeriod: 5,
        backupWindow: '04:00-04:30',
        maintenanceWindow: 'sun:04:30-sun:05:30',
        allowMajorVersionUpgrade: true,
        autoMinorVersionUpgrade: true,
        finalSnapshotIdentifier: `${serviceName}-${env}-rds-final-snapshot`,
        skipFinalSnapshot: true,
        copyTagsToSnapshot: false,
        multiAz: rdsConfig.getBoolean('multiAz') || false,
        applyImmediately: rdsConfig.getBoolean('applyImmediately') || false,
        vpcSecurityGroupIds: [rdsSg.id],
        port: 5432,
        name: serviceName,
        username: 'postgres',
        password: rdsConfig.requireSecret('adminPassword'),
        dbSubnetGroupName: rdsSubnetGroup.name,
        parameterGroupName: rdsParamGroup.name,
        performanceInsightsEnabled: rdsConfig.getBoolean('performanceInsights') || false,
        monitoringInterval: 0,
        deletionProtection: env === 'prod',
      },
      {
        protect: env === 'prod',
      },
    );

This is part of the output:
     └─ aws:rds:Instance                        qa-postgres                 1 error

Diagnostics:
  aws:rds:Instance (qa-postgres):
    error: aws:rds/instance:Instance resource 'qa-postgres' has a problem: ConflictsWith

If I remove the identifierPrefix it works. If I make identifier undefined it still errors. I'm just trying to create a database with a consistent name but including the random part at the end. I can't tell if this is a terraform provider or pulumi code problem because I don't have an up to date terraform config to test this with.

Hey @chrisportela, I suspect it's the identifierPrefix property that is causing the issue. Can you try omitting that and see if the error goes away?

yes it does go away if I remove identifierPrefix but then it uses the resource name as the prefix.

@clstokes @stack72 A co-worker reading this issue assumed I was using identifier and identifierPrefix together so I just want to make sure it's clear the issue is only using identifierPrefix by itself. If I remove that everything works fine, but it's using the resource name as the prefix.
I think this is a legit bug in either terraform or pulumi instead of just the warning being a little vague.
We're using Node 12.19.1 and these are our versions of pulumi packages
├─<EMAIL_ADDRESS>├─<EMAIL_ADDRESS>├─<EMAIL_ADDRESS>├─<EMAIL_ADDRESS>├─<EMAIL_ADDRESS>│  ├─<EMAIL_ADDRESS>│  └─<EMAIL_ADDRESS>

So the issue here is that Pulumi will always specify a name parameter - either directly or indirectly (through autonaming)
This means that there's a bug here that the name-prefix is useless when using Pulumi
Ok, leave this one with me to talk about with other members of the team and see what we should do here

While the error message improvement discussed in https://github.com/pulumi/pulumi-terraform-bridge/issues/309 will help here - I believe the core issue is - as @stack72 notes - that these prefix properties will not work correctly with autonaming.  This is a deeper issue that will need to be addressed.

We're still having this error. As a work around we simply name the resource what we want prefixed and then it gets the random letters added on the end.

We no longer see this error. I am able to deploy an aws.rds.Instance with identifierPrefix set:
name: example
runtime: yaml
resources:
  aws-provider:
    type: pulumi:providers:aws
    properties:
      region: us-east-2
    defaultProvider: true
  res:
    type: aws:rds:Instance
    properties:
      identifierPrefix: "foo"
      engine: "postgres"
      instanceClass: "db.t3.micro"
      allocatedStorage: 20
      username: "myusername"
      password: "mypassword"
      skipFinalSnapshot: true
outputs:
  actual: ${res.identifier}

Do you want to perform this update? yes
Updating (test)

View in Browser (Ctrl+O): https://app.pulumi.com/pulumi/example/test/updates/162

     Type                 Name                     Status
     pulumi:pulumi:Stack  example
 +   └─ aws:rds:Instance  res                      created (215s)

Outputs:
  + actual: "foo20230811083041830000000001"

Resources:
    + 1 created
    2 unchanged

Duration: 3m40s


http logging doesn't seem complete, even w/ -l debug

Hi there!
Building from the current master (as of this note's timestamp)
Linux xxx.net 4.19.0-14-amd64 #1 SMP Debian 4.19.171-2 (2021-01-30) x86_64 GNU/Linux
The build worked fine, new package was created and installed.
merecat -V
2.32-rc4
Seems to operate well enough from a browser's view with a minimal port-80 initial test install, except for the traffic logging only seems to show errors like 304 and 404 best I can tell, even when started with
merecat -n -f /etc/merecat.conf -l debug
(all messages to stdout, right?)
with /etc/merecat.conf containing only:
username = www-data
directory = /var/www
Your default merecat webpage content is in /var/www and displays correctly, but the only logging I can see is the process start-up info, the http 404s and the 304s - no 200s.
Further (another bug report?) the man page indicates CLI -r and -d options, neither of which works or appears in the merecat -h usage message, as well as some of the other merecat(8) listed options (still on the todo list?)
Lastly, why is it that the newly built deb package that builds from my updated/cloned repo indicates install files with modify dates of "July 7, 2020" on all of the installed files? The 'dpkg-deb --contents' of the new deb file shows the same. Odd that, even after a "make distclean", ./autoconf.sh, ./configure, make package sequence, the resulting installed files in /usr/sbin/merecat are dated July 7, 2020. Is there a forced date in the package build rules (I'm not too savvy about pkg building)?
But thanks for keeping this little gem alive (I've been using thttpd for years now, but it's time for me to upgrade..., and your updates tie it all up very nicely - ssl, etc.)
I hope this info helps, and I can test further if it will help.
cheers,
mindsong

It has been many years since I started patching up this fork, so I don't remember all the design decisions I made, but this project is not thttpd, so you cannot infer any behavior it had on this project.  Also, the master branch is unreleased and still very much under development. The issues you mention about .deb package and out-of-sync command line options are not something I'll go into detail on, but I'd say normal state for an in-progress project. There's a lot of bigger issues to address before turning to fix them.  Meanwhile, there are released versions (with lot less features) that I recommend to anyone who want to use this project for now.

Hello Mr. Wiberg,
Thanks for the reply, and thanks for keeping this handy tool alive.
I appreciate that your make-over of the original thttp project is ongoing and quite substantial, if not almost a rewrite. I'm also very pleased that you have preserved the original "way of thinking" that Mr. Poskanzer designed into the original tool. Bravo for that.
I was hoping that the logging problem was a 'user error', or perhaps it was a runtime or compile-time setting that hasn't been fully detailed in the documentation yet. I can look into the repo and perhaps see if I've missed something. I expect that the logging code is present and mature, simply not enabled due to the way I am running the program.
I'm not at all worried that the deb package mechanism hasn't been updated. It only caught my eye when the file date in /usr/sbin was 2 years old and I had just built and installed it - that was unexpected, and made me wonder if I was doing what I believed I was doing. I'm glad to know that it's not unexpected at this point.
I have a great understanding of 'works in progress' that don't claim to be complete (current/master branches), but are treated as though they are complete anyway - look at the piles of projects on my desk for verification of that! :). My feedback is intended to help identify user-problems, or program issues before they become releases!
As mentioned before, thanks for your continued work this wonderful little tool. Perhaps I could help with some of the more peripheral updates to the codebase - e.g. documentation and examples of usage if that would be helpful. I will peruse the repo before I make promises that may be over my head!
best, and thanks for the reply,
--ms

I also miss 200 OK in logging, same as in original report of this issue.


ENH: add ids for the onedal4py test cases sycl_queue param

Description
Onedal4py tests uses get_queue helper func for getting sycl_queues on available devices. This auto created by pytest ids are not informative and absolutely are not useable in case of having deselected_tests list, that we are going to use later.
Currently we have some test cases for onedal4py that skipped by hardcoding, that will be updated via using deselected tests list.

add ids for the onedal4py test cases sycl_queue params\

TODO
add deselected_tests list for sklearnex and onedal4py own tests

/intelci: run


"Preview in this channel" and "Export detailed results" aren't working. I get error 403 BotNotInConversationRoster

Hello,
I have problems with Company Communicator. I get the error 403 when I click on the buttons: "Preview in this channel" and "Export detailed results".
This issue does not affect the other Company Communicator features, for example: I can create and send messages correctly.
In logs I saw that the error has the code "BotNotInConversationRoster" and the message "The bot is not part of the conversation roster." I think the error may be in Company communicator (Authors) bot.
Company communicator is installed in a private Microsoft Teams channel.
I tried these things to solve the error, but none worked:

I uninstalled and installed again Company Communicator in the same Channel.
I mentioned Company Communicator (Authors) in the channel.

Is any other thing I can try to solve my issue?
Regards.

Same problem here after deploy v4.1.4. On version 4.1.3 it did not happen.

I'm still getting the same error messages.
This is the message when exporting detailed results:

And this is when I try use "Preview in this channel":

Bots in private channel doen't work. So,it is expected behavior.


Updated event information Dresden

Source: http://www.meetup.com/OK-Lab-Dresden

Closed in favor of #419.


issue with chatglm2-6b

i saw the issue with chatglm2-6b.
it run successfully if with numactl  -m 0 -C 0-23.
it run failed if with numactl  -m 0 -C 0-31, or 0-47 , or 0-55.
i can be reproduced with INT8_ASYM  or 4BIT_MAXIMUM quantization
here the command to do quatization:
python3 convert.py --model_id $model_path -c $DATA_TYPE --output_dir $target_path
here is the command line to do inference
numactl  -m 0 -C 0-47  python benchmark.py -m /app/savedmodels/THUDM/chatglm2-6b/pytorch/dldt/compressed_weights/OV_FP32-INT8_ASYM/ -d CPU -n 3 -p "It is done, and submitted. You can play 'Survival of the Tastiest' on Android, and on the web. Playing on the web works, but you have to simulate multiple touch for table moving and that can be a bit confusing. There is a lot I'd like to talk about. I will go through every topic, insted of making the typical what went right/wrong list. Concept Working over the theme was probably one of the hardest tasks which I had to face. Originally, I had an idea of what kind of game I wanted to develop, gameplay wise - something with a lot of enemies/actors, simple graphics, maybe set in space, controlled from a top-down view. I was confident that I could fit any theme around it. In the end, the problem with a theme like 'Evolution' in a game is that evolution is unassisted. It happens through several seemingly random mutations over time, with the most apt permutation surviving. This genetic car simulator is, in my opinion, a great example of actual evolution of a species facing a challenge. But is it a game? In a game, you need to control something to reach an objective. That control goes against what evolution is" -r /app/output/chatglm2-6b-4BIT_MAXIMUM-16-256-256.1.csv -ic 256 -mc 2 -bs 16 --torch_compile_backend openvino --fuse_decoding_strategy -od /app/output --genai
[ INFO ] ==SUCCESS FOUND==: use_case: text_gen, model_type: chatglm2-6b
[ INFO ] OV Config={'CACHE_DIR': ''}
[ INFO ] OPENVINO_TORCH_BACKEND_DEVICE=CPU
[ INFO ] Model path=/app/savedmodels/THUDM/chatglm2-6b/pytorch/dldt/compressed_weights/OV_FP32-INT8_ASYM, openvino runtime version: 2024.4.0-16579-c3152d32c9c-releases/2024/4
[ INFO ] Pipeline initialization time: 0.98s
[ INFO ] Numbeams: 1, benchmarking iter nums(exclude warm-up): 3, prompt nums: 1, prompt idx: [0]
[ INFO ] [warm-up] Input text: It is done, and submitted. You can play 'Survival of the Tastiest' on Android, and on the web. Playing on the web works, but you have to simulate multiple touch for table moving and that can be a bit confusing. There is a lot I'd like to talk about. I will go through every topic, insted of making the typical what went right/wrong list. Concept Working over the theme was probably one of the hardest tasks which I had to face. Originally, I had an idea of what kind of game I wanted to develop, gameplay wise - something with a lot of enemies/actors, simple graphics, maybe set in space, controlled from a top-down view. I was confident that I could fit any theme around it. In the end, the problem with a theme like 'Evolution' in a game is that evolution is unassisted. It happens through several seemingly random mutations over time, with the most apt permutation surviving. This genetic car simulator is, in my opinion, a great example of actual evolution of a species facing a challenge. But is it a game? In a game, you need to control something to reach an objective. That control goes against what evolution is
[ INFO ] [warm-up] Batch_size=16, all input token size after padding: 256 * 16, all max_output_token_size: 256 * 16
[ ERROR ] An exception occurred
[ INFO ] Traceback (most recent call last):
File "/app/benchmark.py", line 856, in main
iter_data_list, pretrain_time = CASE_TO_BENCH[model_args['use_case']](model_path, framework, args.device, model_args, args.num_iters)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/benchmark.py", line 462, in run_text_generation_benchmark
text_gen_fn(input_text, num, model, tokenizer, args, iter_data_list, md5_list, prompt_idx_list[idx], bench_hook, model_precision, proc_id)
File "/app/benchmark.py", line 348, in run_text_generation_genai
generation_result = model.generate(input_text_list, max_new_tokens=max_gen_tokens, num_beams=args["num_beams"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Exception from src/inference/src/cpp/infer_request.cpp:223:
Exception from src/plugins/intel_cpu/src/graph.cpp:1243:
Node __module.transformer.encoder.layers.0.self_attention.core_attention/aten::scaled_dot_product_attention/ScaledDotProductAttention of type ScaledDotProductAttentionWithKVCache
Check 'B == B_state' failed at src/plugins/intel_cpu/src/nodes/scaled_attn.cpp:1393:
beam idx batch: 14 is not equal to batch of state: 16

@QuPengfei Can you please share the output of "lscpu", "numactl -H", "lscpu -e"? If this can be reproduced with other models?

@QuPengfei  any updates here?

@QuPengfei Please verify with chatglm3 or glm4 with latest openvino.genai and create new ticket.


Add ctrl+w idle in normal mode

Hi,
most browsers closes the current tab by pressing ctrl+w, which is overwritten in insert mode. Is it possible to catch the shortcut and just idle in normal mode?

Chrome allows you to overwrite this shortcut, You can patch firefox to allow you this. On MacOSX the tab-closing operation is mapped to cmd-w not ctrl-w. And the shortcut is already defined for insert mode and works for me. I just asked to add one line more to the vim.js bindings where the the shortcuts idles in normal mode like vim does.

I see — in that case, you could submit a pull request. The vim mode doesn't have an active maintainer anymore, so it's unlikely anyone else will pick this up.


Mark optional fields and add required fields explanation on the TI "Add Client" form

Description
On the TI "Add Client" form, we are following the UX recommendation of indicating optional fields by adding "(optional)" to the label.  We have also added a text description at the top of the form indicating that a red asterisk denotes required.  For now, this only applies to the TI form, but a future issue will ensure that we consistently apply these indicators across the CiviForm application.
Release notes
On the TI "Add Client" form, we are following the UX recommendation of indicating optional fields by adding "(optional)" to the label.  We have also added a text description at the top of the form indicating that a red asterisk denotes required.
Checklist
General
Read the full guidelines for PRs here

[x] Added the correct label: < feature | bug | dependencies | infrastructure | ignore-for-release | database >
[x] Created unit and/or browser tests which fail without the change (if possible)
[x] Performed manual testing (Chrome and Firefox if it includes front-end changes)

User visible changes

[x] Tested on mobile view. See mobile device mode
[x] Manually tested at 200% size

Issue(s) this completes
Fixes #5402

In the Note:, how hard would it be to make it a red * instead?

I considered changing the color and don't think it would be that hard, but I'd be changing it in other places of the application too, such as in the application block view.  I plan on creating an issue for the way we handle these things in the rest of the app, maybe this could be a part of that issue?  That way, these changes would stay within the scope of the TI page.

I think a red asterisk would work. Using the tailwind color red-700.
Are there any other design requests blocking this issue @melanie-exygy ?

I think a red asterisk would work. Using the tailwind color red-700.
Are there any other design requests blocking this issue @melanie-exygy ?

Thanks @sijiayam !  I'll change the asterisk color in the explanation text .  No other design questions for this issue.


'Next' page button is not working

Was caused by bug in dependant lib. Fixed after in 0.0.44 release.


Distorted voice on Android Browsers

The website works fine on desktop but gives a distorted voice on Android browsers  chrome , opera etc.
Please help me with this issu my website link :
https://arline-fernandez.firebaseapp.com/

I am seeing the same problem. Any workaround?

I really love this package but the distortion in mobile browsers is rough. Any tips to fix this?

We don't use this on mobile devices and I don't have time to look into this closely, but we'd be glad to accept PRs for anyone that wanna play with the code and try to figure out what's going on.

I'm having the same trouble with mobile devices.  @buzinas do you have any theories on where to start looking for a solution? I'm. happy to have a poke around and see if I can find a solution 👍

Currently we encode in "real-time":, while we're processing the audio. This might be too much for a mobile processor to handle (processing audio and conversion). This is the first thing I'd try: save the audio Buffer to memory, and only encode it on stop.

I've prepared PR with encodeAfterRecord param in configuration.
This could help with sound distortion on mobile devices!

Qq

Any chance of a new release with this encode after record feature soon?

It's a good question :)
@buzinas?

Sure, I'll review it soon! Thanks for the PR :)

Just an update: we're currently finishing a cycle, but will be able to work on this in October.

Are there any updates on this? I really need a decent audio recorder for my project. I've been looking for one for the past 6 hours and they all suffer from the same issue.

Will love to get an update on this issue as well.

Based on the fact that ScriptProcessorNode is deprecated for years, have you explored the possibility to migrate to use Audio Worklet since they does not rely in the main thread to do the "heavy job" ?
https://developer.chrome.com/blog/audio-worklet/

@picasocro1 did you try if your patch worked?
I tried but it seems it does not fix the issue on mobile.
Thanks for the help


Update last written LSN after walloging all createdb stuff

Problem
See https://neondb.slack.com/archives/C033RQ5SPDH/p1694595347598249
Summary of changes
Update last written LSN after walloging all createdb stuff
Checklist before requesting a review

[ ] I have performed a self-review of my code.
[ ] If it is a core feature, I have added thorough tests.
[ ] Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
[ ] If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

Checklist before merging

[ ] Do not forget to reformat commit message to not include the above checklist

Test failure seems unrelated.

Have we come up with any way to test the changes to make sure this doesn't happen again?

PG14 has different implementation of CREATE DATABSE: it doesn't have CreateDatabaseUsing* functions and writing XLOG_DBASE_CREATE is done at the end of database creation - when all tables are already created.


The callback of sx props behaves differently than expected.

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Current behavior 😯
callback for Real css key

callback for Sx Props css key

Expected behavior 🤔
It seems to be correct that the value does not come out as if the value does not work when a real CSS key is used.
Or, when you write a code that spit json from a real css key, you need a code that spit out a type error.
Steps to reproduce 🕹
No Steps...
Context 🔦
I already knew that sx props can return a value via callback.
However, while working, I accidentally returned a css Json value to the callback, and it was confirmed that it worked. And It has been confirmed that the operation does not operate on all key values, but on the key of only sx props.
So I read the sx props document, but I couldn't find anything about it, so I thought it was a bug, so I posted an issue.
I wonder if this is intended, and if so, what kind of logic works.
Thanks for reading this long post.
Your environment 🌎
System:
ubuntu 22.04
Binaries:
node v16.16.0
npm 8.11.0
npmPackages:
"react": "^18.2.0",
"@types/react": "^18.0.15",
"@mui/material": "^5.9.0",
"@emotion/react": "^11.9.3",
"@emotion/styled": "^11.9.3",
"react-dom": "^18.2.0",
"typescript": "^4.7.4",

This does not look like an issue as in the documentation of sx, it is clearly mentioned that
The backgroundColor property is also available through its alias bgcolor

Let's see what others say.

What I was saying was why the following css object can return in sx props related keys like bgcolor.
This is not to say that bgColor is not equal to backgroundColor. This problem is that sx Props callback can return Css Object and it works. And i wonder why it works.

@benovice
Users sometimes want to pass responsive values to CSS properties, and they can do so using sx prop.
e.g., sx={{ display: { xs: 'inline-flex', sm: 'none' } }}

@hbjORbj
Thanks for your explain!! :)