Add index

Intro-HTML

I can't merge because there are conflicts that are "too complex to be resolved in this web editor" and I don't really understand the command line instructions cause I'm new here :(


Removed slowapi from code

@kravetsmic , you'll need to run "make pip-compile" to get the version bump of unstructured-api-tools in requirements/base.txt.

This has been resolved by https://github.com/Unstructured-IO/pipeline-sec-filings/pull/135 .


Highlight stuff that already works in the readme

it's hard to find it in the samples right now.

Yes good point. I will try to write some stuff up.

Added a "what works" section in the readme. Let me know if more detail is required.


Unable to npm install Angular apps (app2, app5)

For the Angular apps (app2 and app5), npm install fails with "404 Not Found<EMAIL_ADDRESS>It seems like eslint-scope 3.7.2 was compromised and that it has been removed from npm repositories, which is probably the cause.

Thanks for the heads-up. I have updated the packages. If you like, you can test it again.

Thanks for the quick fix, seems to work fine now!


Allow installing modules when connecting a db

Evaluate Postgraphile or restore the install rest endpoint

We resolved this with postgraphile in PR #662


Deploy logfire for observability

The team behind Pydantic has made a new observability solution, logfire, and I think this would be great for us to try out. It offers both logging and metrics, so we can both view logs from Mainframe and also metrics such as packages ingested, packages failed, malicious packages, etc... It also allows us to view SQL queries and their durations and set up alerts.
Some features Logfire provides that I think would be of particular use to us:

Alerts for particular events: Logfire supports sending webhooks in Slack format, Discord also accepts Slack-formatted webhooks. See here
Metrics: Allows us to collect metrics in a variety of forms. For instance, we can collect packages ingested and display a time series graph of package ingest to determine period of high package ingest.

We can also instrument FastAPI this way, so we can collect information on things like average request duration (and also plot this on a time series graph)

We can collect logs, and view them in Logfire's dashboards.
We can add all the core developers and give them access to logs and metrics.
Logfire integrates with pretty much everything we use: FastAPI, SQLAlchemy/Psycopg, Structlog, Pydantic, and HTTPX.

Compared to similar products like Prometheu  and Loki, Logfire provides an all-in-one solution that focuses on simplicity, rather than customization options. It has all the features we need for observability, and will allow us to get it set up and maintained easily.
One potential point of contention is that their dashboard is proprietary, and the way it's marketed implies that there are very little restrictions and is completely free, but only because it's in beta, and that the Logfire team may start adding restrictions and move to a paid model. While I could argue that it may be something that's worth paying for, because Logfire also integrates with OpenTelemetry, we can use other tools and dashboards in the future if we need to.

Go for it-- I don't have much to say in this regard except that I think we're going to regret this decision.


turn on TCP keepalive option, send ping every 10 minutes

I started a wormhole send last night, and didn't do the matching receive until the next morning. The two sides then failed to connect. It looks like both the sender and the server think they have a websocket connection open, but my home router's NAT table had dropped the forwarding entry because it hadn't seen any traffic in a while.
We need to turn on the TCP_KEEPALIVE option on both ends, so they eventually give up on connections that are broken this way. Note that TCP_KEEPALIVE doesn't actually keep anything alive, usually: it merely accelerates connection death. The specific behavior (using the default linux kernel settings is): when two hours pass without any outbound (ACK-able) traffic, start sending pings (which should provoke ACKs) every 75 seconds; when 11 of these have been sent without a response (about 10 minutes), drop the connection. The new messages occur far to late to prevent a NAT box from timing out. So it really just reduces the idle-until-dead time from infinity seconds to about two hours.
It's possible to change these settings in the kernel, but almost nobody does, so you always need some application-level timers.
We also need something to send a periodic ping message, maybe once every 5 or 10 minutes, to keep the NAT entry alive. I'll check to see if Autobahn already has an option for this.. seems like a pretty common issue with long-running websockets (something I'd expect to be included in the spec, in fact).
There's a pathological failure mode here, where the server is doing TCP_KEEPALIVE, but the client is not, and the NAT entry gets deleted. The server sees the socket disconnect (from the timeout), then eventually expires the nameplate (about 20min with the new expiration code). If the second client tries their wormhole receive after this point, they'll wind up re-allocating the same nameplate (since it's now idle), and then they'll wait forever for a sender which has already been lost. And the sender doesn't realize anything's gone wrong because they have keepalives turned off, so they think they still have a connection.
Fortunately, sending a periodic ping should both prevent the NAT entry from expiring, and will detect it fairly quickly (a few minutes, I think) if it ever does get dropped.

meejah pointed out that Autobahn (the websocket library we use) has application-level options for that. We just need to do factory.setProtocolOptions(autoPingInterval=60, autoPingTimeout=600) or so (send a PING message every minute, drop the connections if a PONG isn't received for 10 minutes).


Feature/fix

Checklist

[X] Application license is compatible
[X] I have created a directory in the form of apps/<application_name>/<version>
[X] I have added the corresponding metadata file
[X] I have added the corresponding README file
[X] I have tested the application in my own namespace and works as expected
[X] I have tested that the application can be uploaded to my catalog namespace

What does this PR do?
Updated Dockerfile to use codercom server as base image.

Properties also updated accordingly

Which as the minimum requirements to launch the application?
1 GB of RAM and 2 CPU.
Any background context you want to provide?
Screenshots (if appropriate)

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: NimishKashyap:x: Alvaro AgeaAlvaro Agea seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


7.3.3 isn't "latest" on Read the Docs

Describe the bug
Opening https://coverage.readthedocs.io/en/latest/changes.html doesn't show 7.3.3, because it isn't marked as the "latest" release there.
To Reproduce
As above.
Expected behavior
It is the latest.
Additional context
n/a

Thanks, I had the settings right, but it wasn't taking.  I changed the settings again, and now the pages are right.

Weird. Thanks!


use camundaBpmProperties in webapp and cloud

Currently, when trying to use the configurationProperties in other projects than the basic starter, we get a spring exception. Seems like the properties are created twice and thus do not work.
To work around this, we use value injection directly, but it would be nice to fix this.

The issue should have the same root cause as #189.

+1 on the this bug. took a while to figure out.
turns out the Configuration objects that @PostConstruct test that they are valid (e.g. adminUser is configured) will cause the whole stack to shutdown if Spring-Cloud-Config-Client is a dependency.
Note, the workaround is to put all camunda properties into the bootstrap.yml file.

Now this works, I guess it was related to spring hierarchy issues, see #244 for example.


event_queue: Replace sequential queue IDs with UUIDs

This prevents ID conflicts when resharding between multiple Tornado shards.

Merged, thanks @andersk!


[release-v1.77] Automated cherry pick of #8443: Fix ControllerRegistration controller not deleting ControllerInstallations when deletionTimestamp is set

/kind bug
/area usability
Cherry pick of #8443 on release-v1.77.
#8443: Fix ControllerRegistration controller not deleting ControllerInstallations when deletionTimestamp is set
Release Notes:
A bug has been fixed that prevented `ControllerInstallation`s from getting deleted when the backing `ControllerRegistration` with `.spec.deployment.policy={Always,AlwaysExceptNoShoots}` was deleted.

/cc @shafeeqes

/lgtm
/approve


Update changelog for Zulip 1.4 release.

Automated message from Dropbox CLA bot
@timabbott, it looks like you've already signed the Dropbox CLA. Thanks!

This may be the last time that we'll be able to do our changelogs in this level of detail, since this is really long!  This is I suppose what we get for having almost 1200 commits since the last release (even though it was just 2 months ago!)

Merged, thanks @timabbott!

(this was merged)


Some dependencies are missing from the script

The PostgreSQL library and curl are required to deploy the single node kubeadm cluster with this script:
sudo apt-get install libpq-dev
sudo apt install curl

@greghugit -- thank you for your feedback and proposed solution.  Are you following a particular docs.microsoft.com article?

Yes, I am following this article:
https://docs.microsoft.com/en-us/sql/big-data-cluster/deployment-script-single-node-kubeadm?view=sql-server-ver15

@greghugit -- thank you for clarifying.
@mihaelablendea -- please look into this issue.

@greghugit  Curl is already included. Why is the PostgreSQL library required?
apt --yes install
software-properties-common
apt-transport-https
ca-certificates
curl

Hi Mihaela,
When I run step #3 from the “Instructions to deploy SQL Server big data clusterhttps://docs.microsoft.com/en-us/sql/big-data-cluster/deployment-script-single-node-kubeadm?view=sql-server-ver15”, it fails with the error “pg_config executable not found” (see below).  I am able to resolve this error by running this command “sudo apt-get install libpq-dev”, prior to running step #3.
Thanks,
Greg
<EMAIL_ADDRESS>From: Mihaela Blendea<EMAIL_ADDRESS>Sent: Thursday, October 15, 2020 8:34 PM
To: MicrosoftDocs/sql-docs<EMAIL_ADDRESS>Cc: greghugit<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/sql-docs] Some dependencies are missing from the script (#5574)
@greghugithttps://github.com/greghugit Curl is already included. Why is the PostgreSQL library required?
apt --yes install
software-properties-common
apt-transport-https
ca-certificates
curl
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/sql-docs/issues/5574#issuecomment-709660774, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AO736HXPMVPZIRWI3KIWNYTSK6IIPANCNFSM4SPAPNOA.

@mihaelablendea Should we add a note that this library package might be required for some users? Or if you think it is not going to be a common issue for any reason, we could wait for more feedback that it is needed. Thank you!

@mihaelablendea Should we add a note that this library package might be required for some users? Or if you think it is not going to be a common issue for any reason, we could wait for more feedback that it is needed. Thank you!


Homeautomation with iPad wont work

Hi guys maybe you can help me.
I'm running homebridge for a few month now and everything runs well.
Now i got a new iPad and wanted to test the automation but it won't work. I tried several configuration (multiple or single devices etc.)
Did it work for anyone of you or is this a common problem?

Can you access the home from iPad? Can you access your home using cellular, with iPad as homekit central?
When I switched to iOS10 last year, I had to re-create my home on my iPad before everything went smoothly. iCloud sync didn't do the trick somehow.

Hi,
I can access everything and also from my iPhone in cellular mode.
I restarted homebridge and deleted it from HomeKit + paired it again. Still it's not working.

Nevermind, after updating the iPad with newest iOS and restarting the router it works like a charm.


1.7.x bug -- redis-limit  key: *-QUOTA ttl is -1

      rate.setReset(SECONDS.toMillis(refreshInterval));
        Long current = 0L;
        try {
            current = redisTemplate.opsForValue().increment(key, usage);
            // Redis returns 1 when the key is incremented for the first time, and the expiration time is set
            if (current != null && current.equals(1L)) {
                handleExpiration(key, refreshInterval);
            }
        } catch (RuntimeException e) {
            String msg = "Failed retrieving rate for " + key + ", will return the current value";
            rateLimiterErrorHandler.handleError(msg, e);
        }
        return Math.max(-1, limit - current);

QUOTA  don't execute handleExpiration(key, refreshInterval);
so  key:   *-QUOTA    ttl  is -1

Hi @keygod, I need a little more info here, if you can help, please tell me. What's the bug? How can I reproduce it?

Hi @marcosbarbero ,
Invoked by the calcRemainingQuota
 current = redisTemplate.opsForValue().increment(key, usage);

The return value  current in   frist request is  0 and second request  is 33 or other value ,So it can't expire
I found in master  this code is
 private Long calcRemaining(Long limit, Long refreshInterval, long usage,
                               String key, Rate rate) {
        rate.setReset(SECONDS.toMillis(refreshInterval));
        Long current = 0L;
        try {
            current = redisTemplate.opsForValue().increment(key, usage);
            // Redis returns the value of key after the increment, check for the first increment, and the expiration time is set
            if (current != null && current.equals(usage)) {
                handleExpiration(key, refreshInterval);
            }
        } catch (RuntimeException e) {
            String msg = "Failed retrieving rate for " + key + ", will return the current value";
            rateLimiterErrorHandler.handleError(msg, e);
        }
        return Math.max(-1, limit - (current != null ? current : 0L));

Can I replace with it?

If you are using the version 1.7.5 then you have to use the branch 1.7.x to fix it

Hello @keygod did you manage to fix this issue?

Hi @marcosbarbero , I  fix it by replace method    RedisRateLimiter.calcRemaining  copy  from branch master

I see. Do you mind telling me how are you using this library?

@marcosbarbero  ,I just deploy to my private  repository ,need me create pull request for this branch?

A PR would be great!


Changing the Partition key value a is a important factor for choosing Partition key

A thing I learned the hard way is, the id is only unique only in one partition:

If I have now a Record with the id 1 in the Partition 'london' and now do an Upsert for the id to changing the Partition key to 'berlin', I got two Records with the id 1 and not as I was expecting one.
I think this should be mention in the guidance for choosing the Partition key.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d52f6d2e-f852-45ce-c205-ee4038d5ecd1
Version Independent ID: e45b7f29-4d75-0dda-0f13-38b644213840
Content: Partitioning in Azure Cosmos DB
Content Source: articles/cosmos-db/partitioning-overview.md
Service: cosmos-db
GitHub Login: @rimman
Microsoft Alias: rimman

@StefanSchoof Thanks for your comment. We are actively investigating and will get back to you shortly.

@StefanSchoof The partition key + item ID collectively identify an item uniquely. So yes items in two different partitions can have the same id.
Not sure if you have read the introduction of the partitioning doc, https://docs.microsoft.com/en-us/azure/cosmos-db/partitioning-overview, we mention this:
_Each item has a unique value for the UserID property. If UserID serves as the partition key for the items in the container and there are 1,000 unique UserID values, 1,000 logical partitions are created for the container.
In addition to a partition key that determines the item’s logical partition, each item in a container has an item ID (unique within a logical partition). Combining the partition key and the item ID creates the item's index, which uniquely identifies the item._

@StefanSchoof we will close this issue if you don't have any further questions.
#please-close

Thanks for pointing me to that part. I just over read it...

Hi,
What should be done in the case I want to change the value for the partition KEey for a document ? Should I delete the original document and insert a new one? From the issued described by @StefanSchoof it seems that replacing the document is not enough?

Updating partition key of a document is not supported scenario. Instead customer can read document , delete document and create new document with updated partition key. I hope this helps. Thanks.

Updating partition key of a document is not supported scenario. Instead customer can read document , delete document and create new document with updated partition key. I hope this helps. Thanks.

Hi just wondering if this is still the case in 2021.
Personally I find it difficult to think of any property in reality that's guaranteed never to be changed other than the uid...
Just to be clear, I mean to update the value of the property specified as parition key, not the partion key path itself.

+1


Update jobseekers.yml

Removed 'apply for jobs' copy from 'create an account' screen.

Review app deployed to https://teaching-vacancies-review-pr-2804.london.cloudapps.digital


❌ Error: Request failed with status code 401 ❌ Code 401: Unauthorized

You need to fill in your API key to get authorized by OpenAI to use this API.
FYI, the free quota should have expired on May or June 2023. So please check your OpenAI account page to make sure that you have access to API usage.


Fix #38 add default path and version

@simon3z  / @Fryguy   pls review.
@Fryguy  -  this is a first step to pass less info on k8s provider side in manageiq when initializing the client


Allow configuration of direct byte buffer cleaner

Currently netty routes all attempts to deallocate a direct byte buffers through PlatformDependent which uses a static Cleaner to free the buffer. The Cleaner will only be available if netty has access to unsafe (obviously because the method to free the buffer is from unsafe). This restriction is a serious one which causes issues with using Netty in an environment without unsafe (Elasticsearch). It is not uncommen to have kernal OOM during times of bursty network usage (additional direct chunks allocated / adhoc allocations that are larger than the pooled chunk size), but plenty of heap space (full GC to clear the direct memory does not occur). This can be limited using a JDK system property (MaxDirectMemorySize), but that puts us down the codepath of forced garbage collections and must be sized correctly (or we can still have direct memory hanging around for a long time).
While it is unlikely that Elasticsearch is going to remove the security manager or enable full usage of unsafe, we would be interested in configuring our own Cleaner and passing it to use with netty. This happens with Lucene already and it is a usage of Unsafe that we would be comfortable with enabling.

I opened #9182 as a proof of concept for how this might work.

@tbrooks8 can you point me to the code in Lucene that does the same ? Just interested to see it :)

@normanmaurer
https://github.com/apache/lucene-solr/blob/master/lucene/core/src/java/org/apache/lucene/store/MMapDirectory.java#L319

classgraph had some extra checks which I'm not sure would apply to Netty.. https://github.com/classgraph/classgraph/blob/a873e317452d711c04855905e527b07923108dbe/src/main/java/nonapi/io/github/classgraph/utils/FileUtils.java#L609
                // Make sure duplicates and slices are not cleaned, since this can result in duplicate
                // attempts to clean the same buffer, which trigger a crash with:
                // "A fatal error has been detected by the Java Runtime Environment: EXCEPTION_ACCESS_VIOLATION"
                // See: https://stackoverflow.com/a/31592947/3950982
                if (attachmentMethod.invoke(byteBuffer) != null) {
                    // Buffer is a duplicate or slice
                    return false;
                }

Closing as the related PR is closed.


Add Phillip and Jon as authors

Not terribly important, but since we've been doing a pass on Cargo.toml anyway..

Coverage remained the same at 0.0% when pulling 3547b3c5c3851c82b7b26d96a2d12ef8651caea7 on jonhoo:add-contributors into 522e3fbf2b4ff5d5732fc61c3923540963bf696e on gimli-rs:master.

@philipc The coveralls issue is apparently known: https://github.com/huonw/travis-cargo/issues/60

That's actually a different coveralls issue, and our coverage script is a workaround for that one.

Ah, ours is actually that kcov itself segfaults. I wonder why...
Also, presumably once a fix for the issue above lands, we can get rid of our coverage script?

Yeah, the current issue is that I think kcov is segfaulting because it needs the --verify option, but it's missing the --verify option because it can't find libbfd, and it can't find libbfd because something has changed in travis. I have no idea why it can't find libbfd, because our .travis.yml specifies binutils-dev, and on my ubuntu version that contains /usr/lib/x86_64-linux-gnu/libbfd.so.
We can get rid of our coverage script once a fix lands, but travis-cargo seems unmaintained. I don't think huonw works on rust anymore (and possibly isn't allowed to).

Maybe if we specify LD_LIBRARY_PATH it can find the so? Although it
certainly seems like that path should be searched by default...
On Jan 22, 2017 7:33 PM, "Philip Craig"<EMAIL_ADDRESS>wrote:

Yeah, the current issue is that I think kcov is segfaulting because it
needs the --verify option, but it's missing the --verify option because it
can't find libbfd, and it can't find libbfd because something has changed
in travis. I have no idea why it can't find libbfd, because our
.travis.yml specifies binutils-dev, and on my ubuntu version that
contains /usr/lib/x86_64-linux-gnu/libbfd.so.
We can get rid of our coverage script once a fix lands, but travis-cargo
seems unmaintained. I don't think huonw works on rust anymore (and possibly
isn't allowed to).
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/gimli-rs/addr2line/pull/28#issuecomment-274392132,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEjS3ZewWeps2qGd_8b3kPlDf2EtUCyks5rVB-kgaJpZM4Lqnsf
.


Unrecoverable error from trying to extract tactic with type parameter

The following results in an unrecoverable error from kremlin:
module Kremlin_tactic

open FStar.Tactics

noextract
let noop (t:Type) : tactic unit = fun _ -> ()

The issue is the type parameter to noop. Note that even with noextract KreMLin attempts to give noop a type signature, which fails. The stack trace is:
Unexpected error
Failure("Embedding not defined for type Type")
Raised at file "pervasives.ml", line 32, characters 17-33
Called from file "src/batList.mlv", line 231, characters 23-28
Called from file "src/ocaml-output/FStar_Extraction_ML_Util.ml", line 1040, characters 16-72
Called from file "src/ocaml-output/FStar_Extraction_ML_Modul.ml", line 969, characters 17-103
Called from file "src/ocaml-output/FStar_Extraction_ML_Modul.ml", line 1027, characters 31-77
Called from file "src/basic/ml/FStar_Util.ml", line 581, characters 19-28
Called from file "list.ml", line 88, characters 24-34
Called from file "src/basic/ml/FStar_Util.ml", line 582, characters 20-56
Called from file "src/ocaml-output/FStar_Extraction_ML_Modul.ml", line 1387, characters 9-89
Called from file "src/basic/ml/FStar_Util.ml", line 581, characters 19-28
Called from file "list.ml", line 88, characters 24-34
Called from file "src/basic/ml/FStar_Util.ml", line 582, characters 20-56
Called from file "src/ocaml-output/FStar_Main.ml", line 99, characters 14-99
Called from file "src/ocaml-output/FStar_Main.ml", line 253, characters 34-51
Called from file "src/ocaml-output/FStar_Main.ml", line 260, characters 8-13

I couldn't reproduce this with a new, trivial DM4F type, so it has something to do with the definition of the tactic effect.

@mtzguido has a fix for this that simply makes noextract bail out earlier: https://github.com/FStarLang/FStar/commit/26f3d243bcd91ef84022c4a6026a9c6856131eda.

Closing since discussion is happening on the F* side


Fix issue when killing transformer process

This is a proposed solution to issue TransformWithExecutable leaks gosaxon zombie processes inside web services #1
The solution was inspired by the discussion in this issue from the official GO GitHub page: https://github.com/golang/go/issues/52580

Thanks for linking the discussion as I would have asked (out of curiosity) why this is needed ;-) ... thanks for the first ever PR and Issue reported for this lib ;-)


Minor updates to adapt changes

Commits:
Update Index.md to reflect TAssist
Fix faulty link in AboutUs.md

Codecov Report

Merging #5 (a950ef8) into master (e6d2035) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master       #5   +/-   ##
=========================================
  Coverage     72.15%   72.15%
  Complexity      399      399
=========================================
  Files            70       70
  Lines          1232     1232
  Branches        125      125
=========================================
  Hits            889      889
  Misses          311      311
  Partials         32       32

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e6d2035...a950ef8. Read the comment docs.


auth, etcdserver: forbid adding a user with empty name

/cc @xiang90 @heyitsanthony

lgtm. defer to @heyitsanthony

lgtm following wording/naming consistency fixes

@heyitsanthony updated for the naming and wording, PTAL

@mitake Thanks!


💡[FEATURE]: Enhancing the blogs page with background

Is your feature request related to a problem? Please describe.
I would like to enhance the blog page so users find it more interactive.
Describe the solution you'd like

it can look a little better with images or a background.
Describe alternatives you've considered
Additional context
Please assign me this issue under SSOC'24.

Go for it!


How to ignore the root prefix

Please answer these questions before submitting your issue.

Why do you submit this issue?
[I] Question or discussion
[ ] Bug
[ ] Requirement
[ ] Feature or performance improvement

Question
Excuse me, I want to ignore the "/" path in the url request, how to write it in the agent configuration file?
agent.ignore_suffix=${SW_AGENT_IGNORE_SUFFIX:/,.jpg}
I wrote this in the configuration file, but it has no effect.
please help。
thanks

If the endpoint is really /, I think this should work. Try debug your agent, and what is the real operation name when segment created.

If the endpoint is really /, I think this should work. Try debug your agent, and what is the real operation name when segment created.

Thank you for your quick reply。
Yes, I am sure the endpoint is /.
Because you can see it in ui.

No, the UI doesn't mean it is. There is an override mechanism in the span operation name. Read EntrySpan source codes.


Feature request: ignore all links between specific section/lines of a file

Feature description
Hi! I was wondering if Lychee can be configured to ignore a specific set of links between two comments of a file, or with in-line comments in a file. For example, I can put out comments in a Markdown file with (<!-- -->) or in Python files with (#), and so on – and Lychee would not parse those links at all.
Motivation
Many links in many files are flaky, and it is not viable to ignore a file completely sometimes – where ignoring all links present between a specific section of a file would be great for CI when using the Lychee action (while also keeping the error on failure input).
Example and proposed solution
This may vary based on different file formats and how comments work for them, but here's an exhibit for a Markdown (.md) file:
[Link 1](https://google.com)

<!-- lychee: linkcheck stop -->

[Link 2](https://amazon.com)
[Link 3](https://twitter.com)
[Link 4](https://github.com)

<!-- lychee: linkcheck start -->

[Link 5](https://youtube.com)
[Link 6](https://github.com/lycheeverse/lychee) <!-- pragma: no linkcheck -->

would disable checking Link 2, Link 3, and Link 4, and also Link 6.
Additional context
I was unable to find a feature or a flag that can provide the requested functionality, but there is always a chance I may have overlooked in the case that there is one. The semantics of what the comment-based indicators can be can be discussed, but I would suppose it helps to have something that provides a start-stop sign between lines of files, and not just an in-line comment after a link (which would make it cumbersome to mark multiple links with that).

Hmm... intriguing!
I'm not 100% sure that I would add that feature to lychee, but there is a workaround you can use today.
Here is a script that I call lychee_skip, which does just that with awk:
#!/bin/bash

# Ensuring that the script exits on the first error
set -eo pipefail

# Check if at least one argument is passed
if [ "$#" -lt 1 ]; then
    echo "Usage: $0 <file>"
    exit 1
fi

FILE="$1"

# Using awk to:
# 1. Exclude lines between 'linkcheck stop' and 'linkcheck start' markers.
# 2. Exclude lines ending with 'pragma: no linkcheck'.
awk '
/<!-- lychee: linkcheck stop -->/,/<!-- lychee: linkcheck start -->/{next}
/<!-- pragma: no linkcheck -->$/ {next}
1
' "$FILE"

You can add your own delimiters for different files etc.
❯❯❯ cat input_file.md                                                                                ✘
[Link 1](https://google.com)

<!-- lychee: linkcheck stop -->

[Link 2](https://amazon.com)
[Link 3](https://twitter.com)
[Link 4](https://github.com)

<!-- lychee: linkcheck start -->

[Link 5](https://youtube.com)
[Link 6](https://github.com/lycheeverse/lychee) <!-- pragma: no linkcheck -->

❯❯❯ cat input_file.md | ./lychee_skip.sh -
[Link 1](https://google.com)

[Link 5](https://youtube.com)

Then you can pipe that to lychee.
❯❯❯ cat input_file.md | ./lychee_skip.sh - | lychee -

Alternatively, if you prefer a Rust solution:
use std::env;
use std::fs::File;
use std::io::{self, BufRead, BufReader};

fn main() -> io::Result<()> {
    let args: Vec<String> = env::args().collect();
    if args.len() < 2 {
        eprintln!("Usage: {} <file>", args[0]);
        std::process::exit(1);
    }

    let filename = &args[1];
    let file = File::open(filename)?;
    let reader = BufReader::new(file);

    let mut skip_section = false;
    for line in reader.lines() {
        let line = line?;
        if line.contains("<!-- lychee: linkcheck stop -->") {
            skip_section = true;
            continue;
        }
        if line.contains("<!-- lychee: linkcheck start -->") {
            skip_section = false;
            continue;
        }
        if skip_section || line.ends_with("<!-- pragma: no linkcheck -->") {
            continue;
        }

        println!("{}", line);
    }

    Ok(())
}

Of course, it could be extended to support more file formats and custom delimiters.
Perhaps you could maintain that in a separate repo for now to see if there's any interest.
I'd be happy to mention the project in the README.md if you like. What do you think? 😃

Glad to hear that this works for now. I'll close this, but if people find it in the future and would like to have that functionality in lychee itself, we can talk about that.


[Linux] Fix meta parser RPATH

fix #10
fix #16

So that locking libclang-dev version to 12 is no longer needed. (Arch Linux is already in libclang.so.13).

This pull request has fixed build errors.


Error - LDAP - Add_user

Hello
I have a problem to add a user ( ldap ) on the console.
An error message appears:
error: name 'ldap_user' is not defined in function: add_user in file: sql.py

Hello,
Looks like a bug, will fix it

It has been fixed in the new release


Fix Merge Conflicts of Catchup PR

Fix conflicts of https://github.com/WideChat/Rocket.Chat.Livechat/pull/45

@Shailesh351 this fixes the conflicts in the PR, but then we will still have to test and confirm the catchup against our widechat/develop branch?  Just confirming.......  thanks.

@ear-dev I have already tested it. This PR contains changes with our widechat/develop merged in to catchup PR. So we are good to go.


fix: auto-upgrade internal configuration model

Fixes #64 and #67
Version 2.9.0 introduced new internal configuration values. For users upgrading the extension, no default value was set and this led to the error in #64.

:tada: This PR is included in version 2.10.0 :tada:
The release is available on:

Chrome Web Store
v2.10.0
GitHub release

Your semantic-release bot :package::rocket:


Add possibility to set a request caching policy

Description
Make the request caching policy configurable.

While session configuration is possible through client initializer we solved it is possible to set the URLCache and the requestCachePolicy of the used URLSession in #20 .


Extension freezes Google image search

When opening a result from a Google image search that contains a deprecated wiki link, the page freezes.
Browser: Chrome
OS: Windows 11
How to Reproduce

Search for 'minecraft wiki' and navigate to the Images tab.
Click on a result that's from Fandom.com.
The search page freezes.

Thanks for the report! I haven't been able to replicate the freezing, but I do notice a slowdown + entire image results being hidden when expanding an image result.
We were previously ignoring image search results by detecting if imgurl= was present in the URL, but Google seems to no longer be including that so we can't rely on it. I'll try to get a fix in ASAP to avoid filtering image results based on the DOM.

Looks like this issue is not expressed the same with the code changes introduced by #776, but it might be beneficial to modify it to still not look at images (there is no noticeable performance impact, but I notice that it tries to reorder elements)

From my previous comment, I mentioned experiencing the following bug:

entire image results being hidden when expanding an image result.

I believe this bug was introduced when I changed our search result container selection to use the parentNode (see https://github.com/KevinPayravi/indie-wiki-buddy/commit/1affa19c9c5c881b0f5396318b4886d384c8ee82). This was done to resolve some other UI bugs when filtering on Google (like https://github.com/KevinPayravi/indie-wiki-buddy/issues/758), but this also caused entire image search results to be selected when doing an image search.
Need to fix not filtering on Google image results and/or adjust the query to not select entire image results as the container.

I'm still testing, but we may be able to include the closest div with a jsname attribute as an option for the search container.
const closestJsName = searchResult.closest('div[jsname]');


FIle Not Found Error

FileNotFoundError: [Errno 2] No such file or directory: '/content/drive/My Drive/myresults/model/DenseEncoder_DenseDecoder_0.042_2020-07-23_02:08:27.dat'

sir can you please guide  us
how to run this model ?
we want to finetune this model


Parse HTML entities

We can use this XMLParserDelegate function:
func parser(_ parser: XMLParser, resolveExternalEntityName name: String, systemID: String?) -> Data?

We should be able to handle named entities like ’ (right single quote) as well as literals like   (hex) and &#0032 (decimal).

It looks like unicode literals (both hex and decimal) are supported out of the box, so we just have to worry about named entities.

Here's an example mapping for named HTML entities in Obj-C: https://github.com/tomwey/iOS-Blank-Project/blob/0e93989e6d9caf250ef1421e4510ee6e258308f4/iOS-Blank-Project/Components/Utils/HTML Stripper/AWEntityTables.m
Note that I haven't yet been able to figure out the right value to return from the aforementioned delegate method.

Followup: that example doesn't work. It's returning the strings UTF-8 encoded as data, and XMLParser doesn't like them either. The search continues.

I'd like to add that text with   or similar HTML entities crashes the XMLParser

Some new info. It looks like this delegate method is only for resolving external entities. More here on the different kinds of entities: https://xmlwriter.net/xml_guide/entity_declaration.shtml
We need to either define entities inline, or more likely for our purposes, see if we can define the entities in a DTD and pass them in to the XML parser.

A reference here that might be useful: https://github.com/inverse-inc/sope/blob/master/sope-xml/SaxObjC/SaxEntityResolver.h


[SW-24816] Fix for remaining additional name if product is no longer a variant-p…

1. Why is this change necessary?
Because of Point 3, this and that
2. What does this change do, exactly?
Removes the option from the article detail

Checks if product was a configurator product before

3. Describe each step to reproduce the issue or behaviour.
Create a product, create variants for this product, delete all variants except the main variant, uncheck the variant checkbox, put the product in your basket and look at the article name.
4. Please link to the relevant issues (if any).
https://issues.shopware.com/issues/SW-24816
5. Which documentation changes (if any) need to be made because of this PR?
///
6. Checklist

[ ] I have written tests and verified that they fail without my change
[x] I have squashed any insignificant commits
[x] This change has comments for package types, values, functions, and non-obvious lines of code
[x] I have read the contribution requirements and fulfil them.

Hey @jinnoflife,
did you try this with the API as well?
Szenario:

Create product with configurator set
Update the product to remove the configurator set.

Also, can you please add tests?

This PR was closed due to inactivity. If this change is still important to you, feel free to create a new pull request.
For more information about our contribution guidelines, see https://developers.shopware.com/contributing/contribution-guideline/.


Mass message delete and message delete refactor

/loki/v1/moderation/messages?ids=1,2,3
{
  meta: {
    code: 200,
    request: [1,2,3],
    results: [{ meta obj }...],
  },
  data: [
     {
       id: 1,
       is_delete: true,
     },
     ...
  ],
}

may want to change to /loki/moderation/messages/v1?ids=1,2,3 (version by endpoint, so we can change/upgrade them individually)
- could promisify more
added DELETE /loki/v1/messages?ids=1,2,3
some test fixing

replace by #15


Multiple retriever's as tool use

Is it possible to use multiple retrievers/tools in the same RAG, where the right retriever is opted based on the prompt selection? Is this possible with DSPy? If so, could you please explain/add an example

Take a look at the forward() method for your pipeline.
psueodcode-ish:
Class ChooseBestRetriever(dspy.Module)

def __init__(self, retriever_params) # define all the things you want in your pipeline
    retriever_one = dspy.Retrieve() # set whatever retriever params you want here
    retriever_two = dspy.Retrieve()
    retriever_three= = dspy.Retrieve()
    choose_retriever = dspy.MultiChainComparison("retriever 1 output, retriever 2 output, retriever 3 output -> best retriever")
    # other modules you need

def forward(self, input): # given input, how should we process it and turn it into the output we want?
    one_output = retriever_one(input)
    two_output = retriever_two(input)
    three_output = retriever_three(input)
    best_retriever = choose_retriever(one_output, two_output, three_output)
    # now that you have best retriever, figure out what to do with it

How do the retrievers differ? That informs how you use them in your pipeline. If they differ significantly, I'd suggest making different small DSPy programs for each retriever.
The proper retriever choosing will be handled in the Teleprompter.compile() stage based on your metric you've chosen. I would suggest compiling examples for the input/output for determining best retriever for your current task. This will likely be difficult. You should be fine with 3-8 examples for train and dev set.
The metric function will evaluate the results of this pipeline, and will be passed to teleprompter.compile() It should evaluate the choose_retriever. Think about how to evaluate if it's a good retriever based on the passages you get. This metric function may be complex, depending on how much you care. If you really want to have a good metric, use another DSPy program as the metric, possibly teleprompted on llama-2 or 3.5-turbo. You'd likely have to think about how you want that to be done as well. A simple metric, without creating another program, could be a hand-crafted GPT evaluation function, which will work okay and not cost too much because you probably don't have 500/0 examples ready to go.
It could look something like this:
def best_passage_metric(gold_passage:str, passages:list):
    """
    Determine if the selected passage is the most relevant passage to query from a list. .
    :param gold_passage: gold passage
    :param passages: list of passages
    :return: pass or fail
    """
    # call GPT
    system_prompt = "You are an expert technical evaluator who is consistent, deterministic, and reliable."
    user_prompt = "Determine if the gold passage is the most relevant passage for the query 'What is the meaning of life?'. Think step by step, and output a function call with your judgement at the end"
    user_prompt += f"#Gold Passage: {gold_passage}\n\n"
    passages.remove(gold_passage)

    for i, passage in enumerate(passages):
        if passage != gold_passage:
            user_prompt += f"Alternative Passage {i}:\n {passage}\n\n"

    response = openai.ChatCompletion.create(
        model="gpt-3.5-turbo",
        messages=[
            {"role": "system", "content": f"{system_prompt}"},
            {"role": "user", "content": prompt},
        ],
        temperature=0,
        functions={
            "name": "is_best_passage",
            "description": "Output if the gold passage is the most relevant passage for the query.",
            "parameters": {
                "type": "object",
                "properties": {
                    "evaluation": {
                        "type": "string",
                        "description": "yes or no"
                    }
                }
            }
        }
    )

    if response["function_call"]["arguments"]["evaluation"] == "yes": # maybe wrong args to get
        return True
    return False

Although, the complicated-ness of that function poses a pretty decent argument as to just using DSPy to code up the metric. Your choice!
I may be wrong about some things, so if someone from the team could verify, would be lovely. Please let me know if you have any more questions for your use-case and I'd be happy to brainstorm with you.

lemme know. don't take it too heavily, it honestly felt pseudo-code-y aside from the gpt-eval. watch out for eval costs if ur running gpt-4.


How to do nested propertyName?

I'm trying to do some nested sections, for adding education and employment, and I am not sure what to put for propertyName?
{{#each changeset.jobs as |job index|}}
   {{f.text-field
     label="Employer Name"
     placeholder="Employer Name"
     required=true
     propertyName="jobs.index.employerName}}
{{/each}}

Since I need to access each index in the array, I am unsure how to proceed. The example above has some pseudocode of what I am looking for.

See https://github.com/martndemus/ember-form-for#quickstart-example
{{#fields-for changeset.jobs.index as |fa|}}
    {{fa.text-field "employerName"}}
  {{/fields-for}}

Thanks @knownasilya somehow my brain didn't connect that with using each and having multiple of the same thing, but just with the example where it is simply fields of a single address. Might be helpful to list explicitly in the docs.

When doing it this way, one f the issues is that it renders quite slowly if you have a large embedded form. I have 9 fields with 28 embedded entries, and it takes about 1.5 seconds for the page to load.

I wouldn't be too sure it's related to this. Ember is quite good at rendering many components, much more than what you describe.

@knownasilya I'm rendering 285 fields, the form takes 1,566.05ms to render.


Ruby editor: typing #{ autocomplete annoying

In general, all autocomplete functionality should obey this rule:

Text automatically inserted in the current line is marked
If the cursor is before a marked character and the marked character is entered, the cursor advances to the right one space and no further effect happens
When leaving focus of the current line, all marking is lost

Following shows an example of a "helpful" autocomplete in Ruby becoming a pain:

:+1:

I noticed the same thing in a coffeescript file.

This functionality is provided by the bracket-matcher package. Would you mind re-opening this issue on that repository?

Thank you, closing, moved https://github.com/atom/bracket-matcher/issues/109

Thanks!


Feat cartesivm badge

As discussed in a thread on L2Beat discord server, it makes sense to have a badge for the Cartesi Machine (alt-vm).

This commit brought other changes not approved yet so it will be closed.


I can't override my Chart values

I'm trying to verify my chart (https://github.com/SonarSource/helm-chart-sonarqube), but I can't override the default values.
I'm trying to apply this values.yaml:
jwtSecret: "dZ0EB0KxnF++nr5+4vfTCaun/eWbv6gOoXodiAMqcFo="

image:
  image:
  pullSecrets:
    - name: pullsecret
  repository: "sonarsource/sonarqube"
  tag: "10.7.0-community"

I tried both commands without success:
$ docker run --net host -e KUBECONFIG=/.kube/config -v "${HOME}/.kube/":/.kube/ -v "$(pwd)/charts":/charts:z "quay.io/redhat-certification/chart-verifier" -F /charts/sonarqube/ci/openshift-verifier-values.yaml -n sonarqube verify /charts/sonarqube

$ docker run --net host -e KUBECONFIG=/.kube/config -v "${HOME}/.kube/":/.kube/ -v "$(pwd)/charts":/charts:z "quay.io/redhat-certification/chart-verifier" -S image.tag=10.7.0-community (...) -n sonarqube verify /charts/sonarqube

In both cases, it will use the default value for the tag: 10.6.0-community. This also applies to any other value. Adding --debug doesn't show any information.
What am I missing here?

@davividal I'll take a look. At face value, it would seem like what you're doing should do what you expect here. I'll update here as I have more information.

@davividal seems to be working here using 1.13.6 of the binary and container image. I'll take a closer look at your chart.

I can replicate what you're seeing with your chart, but not mine. Still investigating. More to come as I have it.

^ This PR should resolve it. The core of the issue is that you have a ci/ directory that's factored in incorrectly in chart-verifier. Until we get a release out containing this fix, you can work around this by moving the ci directory in your workflow, and specifying its values manually if you need its content.

This has merged, and a new release is being cut for it. https://github.com/redhat-certification/chart-verifier/pull/467. When this is merged, you should be able to try again with the latest image. In the meantime, you can try with the 0.1.0 tag which should contain the fix as well.


link in wiki leads to 404

the link in Building -> Deploy the build leads to 404.

Fixed, thanks for pointer.


[SPARK-13146][SQL] Management API for continuous queries

Management API for Continuous Queries
API for getting status of each query

Whether active or not
Unique name of each query
Status of the sources and sinks
Exceptions

API for managing each query

Immediately stop an active query
Waiting for a query to be terminated, correctly or with error

API for managing multiple queries

Listing all active queries
Getting an active query by name
Waiting for any one of the active queries to be terminated

API for listening to query life cycle events

ContinuousQueryListener API for query start, progress and termination events.

Test build #50589 has started for PR 11030 at commit 40c6444.

Test build #50589 has finished for PR 11030 at commit 40c6444.

This patch fails RAT tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class ContinuousQueryManager

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50589/
Test FAILed.

@marmbrus @zsxwing Please review!

Test build #50597 has started for PR 11030 at commit b6c2517.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50595/
Test FAILed.

Merged build finished. Test FAILed.

Test build #50597 has finished for PR 11030 at commit b6c2517.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50597/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50596/
Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50732/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50733/
Test FAILed.

Merged build finished. Test FAILed.

Test build #50735 has started for PR 11030 at commit 2f93585.

Test build #50735 has finished for PR 11030 at commit 2f93585.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50735/
Test FAILed.

Test build #50763 has started for PR 11030 at commit ea87269.

Test build #50763 has finished for PR 11030 at commit ea87269.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50763/
Test FAILed.

Test build #50767 has started for PR 11030 at commit 2deebff.

Test build #50767 has finished for PR 11030 at commit 2deebff.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50767/
Test FAILed.

Merged build finished. Test FAILed.

retest this please. The master has been fixed.

Test build #50771 has started for PR 11030 at commit 2deebff.

Test build #50771 has finished for PR 11030 at commit 2deebff.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50771/
Test FAILed.

Test build #2519 has started for PR 11030 at commit 189e169.

Test build #2519 has finished for PR 11030 at commit 189e169.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #50787 has started for PR 11030 at commit 189e169.

Test build #50787 has finished for PR 11030 at commit 189e169.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50787/
Test FAILed.

Test build #2520 has started for PR 11030 at commit 189e169.

Test build #50790 has started for PR 11030 at commit a649ac9.

Test build #2520 has finished for PR 11030 at commit 189e169.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #50790 has finished for PR 11030 at commit a649ac9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50790/
Test PASSed.

Test build #50953 has started for PR 11030 at commit 2697218.

Test build #50953 has finished for PR 11030 at commit 2697218.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
             s\"Unable to generate an encoder for inner class$`
case class AssertNotNull(child: Expression, walkedTypePath: Seq[String])
case class NaturalJoin(tpe: JoinType) extends JoinType
case class ReturnAnswer(child: LogicalPlan) extends UnaryNode
case class CollectLimit(limit: Int, child: SparkPlan) extends UnaryNode
trait BaseLimit extends UnaryNode
case class LocalLimit(limit: Int, child: SparkPlan) extends BaseLimit
case class GlobalLimit(limit: Int, child: SparkPlan) extends BaseLimit
case class TakeOrderedAndProject(

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50953/
Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50952/
Test FAILed.

Build finished. Test FAILed.

Test build #50954 has started for PR 11030 at commit 144adbb.

Test build #50954 has finished for PR 11030 at commit 144adbb.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50954/
Test FAILed.

Test build #50955 has started for PR 11030 at commit 5c3c690.

Test build #50955 has finished for PR 11030 at commit 5c3c690.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50955/
Test PASSed.

Merged build finished. Test PASSed.

Just some nits. Otherwise LGTM

Test build #51020 has started for PR 11030 at commit d0003cf.

I addressed the multifailure case and added unit test for it.

Test build #51020 has finished for PR 11030 at commit d0003cf.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51020/
Test FAILed.

Test build #51021 has started for PR 11030 at commit b0d5533.

Test build #51021 has finished for PR 11030 at commit b0d5533.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51021/
Test FAILed.

Test build #51022 has started for PR 11030 at commit d7b1d97.

Test build #51022 has finished for PR 11030 at commit d7b1d97.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51022/
Test FAILed.

test this again.

Test build #2529 has started for PR 11030 at commit d7b1d97.

test this please.

retest this

Test build #51030 has started for PR 11030 at commit d7b1d97.

Test build #2529 has finished for PR 11030 at commit d7b1d97.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #51030 has finished for PR 11030 at commit d7b1d97.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51030/
Test FAILed.

Merged build finished. Test FAILed.

Found the failure cause:
Hadoop FileSystem API will wrap InterruptedException as IOException...
java.io.IOException: java.lang.InterruptedException
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:508)
	at org.apache.hadoop.util.Shell.run(Shell.java:418)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
	at org.apache.hadoop.util.Shell.execCommand(Shell.java:739)
	at org.apache.hadoop.util.Shell.execCommand(Shell.java:722)
	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:633)
	at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:467)
	at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:456)
	at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:906)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:887)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:784)
	at org.apache.spark.sql.execution.streaming.FileStreamSource.writeBatch(FileStreamSource.scala:186)
	at org.apache.spark.sql.execution.streaming.FileStreamSource.fetchMaxOffset(FileStreamSource.scala:115)
	at org.apache.spark.sql.execution.streaming.FileStreamSource.getNextBatch(FileStreamSource.scala:139)
	at org.apache.spark.sql.execution.streaming.StreamExecution$$anonfun$3.applyOrElse(StreamExecution.scala:182)
	at org.apache.spark.sql.execution.streaming.StreamExecution$$anonfun$3.applyOrElse(StreamExecution.scala:179)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$3.apply(TreeNode.scala:262)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$3.apply(TreeNode.scala:262)
	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:70)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:261)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformDown$1.apply(TreeNode.scala:267)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformDown$1.apply(TreeNode.scala:267)
	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$5.apply(TreeNode.scala:304)
	at scala.collection.Iterator$$anon$11.next(Iterator.scala:370)
	at scala.collection.Iterator$class.foreach(Iterator.scala:742)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1194)
	at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
	at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
	at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
	at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:308)
	at scala.collection.AbstractIterator.to(Iterator.scala:1194)
	at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:300)
	at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1194)
	at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:287)
	at scala.collection.AbstractIterator.toArray(Iterator.scala:1194)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transformChildren(TreeNode.scala:353)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:267)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transform(TreeNode.scala:251)
	at org.apache.spark.sql.execution.streaming.StreamExecution.attemptBatch(StreamExecution.scala:179)
	at org.apache.spark.sql.execution.streaming.StreamExecution.org$apache$spark$sql$execution$streaming$StreamExecution$$runBatches(StreamExecution.scala:123)
	at org.apache.spark.sql.execution.streaming.StreamExecution$$anon$1.run(StreamExecution.scala:74)

So if we call stop()(interrupt) while a batch is writing some file, we will get IOException...
One workaround is adding addCheck() above this line: https://github.com/apache/spark/blob/master/sql/core/src/test/scala/org/apache/spark/sql/StreamTest.scala#L339
Then we can make sure no batch is writing any file when we call stop.
Another one is we should allow exception happens in this test since we randomly start and stop the stream multiple times.

Test build #51055 has started for PR 11030 at commit 9caec83.

Test build #51055 has finished for PR 11030 at commit 9caec83.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51055/
Test FAILed.

Test build #51062 has started for PR 11030 at commit 458199b.

Test build #51062 has finished for PR 11030 at commit 458199b.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51062/
Test PASSed.

LGTM


Change default email address from<EMAIL_ADDRESS>to<EMAIL_ADDRESS>

In the default config.el we get:
user-mail-address<EMAIL_ADDRESS>
doe.com is a private domain name.
We should use example.com for the email, such as<EMAIL_ADDRESS>This means that if someone uses a service and doesn't change the domain, someone might buy doe.com and bad things could happen.
We can guarantee that example.com will always be the de-facto example email.

Thanks for the suggestion, but this is not a real problem. The closest user-mail-address comes to being used for sensitive information is to look up your public ssh/pgp key by email address (instead of by fingerprint). If this were truly exploitable, there would be nothing stopping malicious third parties from using<EMAIL_ADDRESS>instead. There is no legitimate security concern here.

Thanks for the suggestion, but this is not a real problem. The closest user-mail-address comes to being used for sensitive information is to look up your public ssh/pgp key by email address (instead of by fingerprint). If this were truly exploitable, there would be nothing stopping malicious third parties from using<EMAIL_ADDRESS>instead. There is no legitimate security concern here.


Unable to connect to System Manager

When I type fusion in the terminal I get the following error:
Unable to connect to System Manager: socket connect '<IP_ADDRESS>:13031': Connection refused
I have tried running Sudo service gefusion restart  and this was unable to solve the issue.

Can you check to see if there are any errors reported in either the geresourceprovider.log or  gesystemmanager.log files under /var/opt/google/log and paste them in the ticket?

[2017-12-20 00:36:31] Notice: --------------- Started ---------------
[2017-12-20 00:36:34] Warning: Unable to connect to resource manager: socket connect '<IP_ADDRESS>:13032': Connection refused
[2017-12-20 00:36:34] Warning: Will keep retrying every 15 seconds
[2017-12-25 13:55:58] Notice: Caught signal 15
[2017-12-25 13:55:58] Notice: Shutting down: 0 jobs left
[2017-12-25 13:55:58] Notice: Exiting

I am running fusion on an Azure vm. I created a port rule in azure portal to allow connection to port 13031 and also disabled ufw within ubuntu. However I am still getting the same error.

@Bshutt This is only the error from the client saying it's unable to connect. It doesn't tell us what's wrong. Is there anything in the geresourceprovider.log file that might indicate why the service won't start? Also try running /etc/init.d/gefusion restart and see if it outputs any error messages.

Since there hasn't been activity on this in a while I'm going to close the ticket. Feel free to open it again if there are still issues.

I have encountered the same problem. Have you solved it before。
Fusion Warning: Unable to connect to System Manager: socket connect '<IP_ADDRESS>:13031': Connection refused

@mochacc usually that means system manager isn't running. Try running sudo service gefusion restart and see if that fixes it. If that doesn't work, you can look for errors in /opt/google/log/gesystemmanager.log.
Another possibility is that your hostname changed after installing Fusion. In that case the machine will think it's a slave, not a master. To fix that, you can run the following commands:
sudo service gefusion stop
sudo /opt/google/bin/geconfigureassetroot --assetroot /gevol/assets --fixmasterhost
sudo service gefusion start

@mochacc usually that means system manager isn't running. Try running sudo service gefusion restart and see if that fixes it. If that doesn't work, you can look for errors in /opt/google/log/gesystemmanager.log.
Another possibility is that your hostname changed after installing Fusion. In that case the machine will think it's a slave, not a master. To fix that, you can run the following commands:
sudo service gefusion stop
sudo /opt/google/bin/geconfigureassetroot --assetroot /gevol/assets --fixmasterhost
sudo service gefusion start

thank you very much，I did change the hostname. According to your method, I can use fusion  now

https://github.com/google/earthenterprise/issues/636#issuecomment-528375092 worked in my case also

i have same problem after fixing this issue but it again after some working
Unable to connect to System Manager: socket connect '<IP_ADDRESS>:13031': Connection refused

i have same problem after fixing this issue but it again after some working
Unable to connect to System Manager: socket connect '<IP_ADDRESS>:13031': Connection refused

Can you try running sudo service gefusion restart? Does that produce an error?
After that, can you also try running ps aux | grep gesystemmanager and post the output?

Can you try running sudo service gefusion restart? Does that produce an error?
After that, can you also try running ps aux | grep gesystemmanager and post the output?


remote gui over SSL

I'm setting up openbazaar-go as a daemon on a remote machine ( CentOS 7.6 OpenVZ VPS) and wanted to connect a local gui client to the remote machine...
I generated the certificates, moved the CA to a client machine, edited my ~/.openbazaar/config and tried to from my client... But it did not work.
I started to investigate, and it seems that when i enable SSL encryption, openbazaar-go no longer listens on the configured gateway port on my ipv4 interface. It starts listening on said port on ipv6 only (eventough only an ipv4 gateway is configured).
If i disable SSL and restart my daemon, it starts listening on the configured gateway port on ipv4.
Ipv6 is not configured on my server nor client, so i cannot try to connect over ipv6
If i'm not using SSL encryption, everything works fine...
So... if i have the following config:
"Gateway": "/ip4/<IP_ADDRESS>/tcp/4009",
"SSL": false,
"SSLCert": "/home/bitcoin/.openbazaar/server.crt",
"SSLKey": "/home/bitcoin/.openbazaar/server.key",
I can connect (no SSL, so my credentials are passed in clear text).
lsof -i :4009
COMMAND    PID    USER   FD   TYPE     DEVICE SIZE/OFF NODE NAME
openbazaa 9188 bitcoin   30u  IPv4<PHONE_NUMBER>      0t0  TCP *:4009 (LISTEN)
But... If i have the following config:
"Gateway": "/ip4/<IP_ADDRESS>/tcp/4009",
"SSL": true,
"SSLCert": "/home/bitcoin/.openbazaar/server.crt",
"SSLKey": "/home/bitcoin/.openbazaar/server.key",
I can no longer connect
COMMAND    PID    USER   FD   TYPE     DEVICE SIZE/OFF NODE NAME
openbazaa 9587 bitcoin   29u  IPv6<PHONE_NUMBER>      0t0  TCP *:4009 (LISTEN)

I can confirm this issue, seeing the same issue. Tried forwarding the public IPV4 port to the IPV6 one with socat but that didn't work out either.
Tried listing only on a IPV6 localhost gateway with "Gateway": "/ip6/::/tcp/4002" and with the socat TCP4-LISTEN:4002,fork,bind=ip.address TCP6:[::1]:4002 command but this crashed openbazaar with [ERROR] [cmd/Execute] protocol not found in multiaddr because apparently ip6 isn't supported for the gateway?
Using the ip4 localhost in the config doesn't work either though as it will just result in a connection refused error in socat, using a public ip4 results in socat not being able to bind even though the port is not getting used in lsof.


Correct context uses

doAPI's context does not work due to WithContext immutability. Authenticate and RegisterApp does not use context although they needs context, so their context does not work also. This pull request fixes them and adds test cases.

Coverage increased (+0.7%) to 74.539% when pulling fb53d41dd9ad507f6988743c690aa0129162036e on MakeNowJust:fix/use-context into 5a3a325689981d84c6cf84f001b9ee47b48c8861 on mattn:master.

Coverage increased (+0.8%) to 74.608% when pulling b105e8554c1ad0b8dab958dee2f94b40a5db0928 on MakeNowJust:fix/use-context into 5a3a325689981d84c6cf84f001b9ee47b48c8861 on mattn:master.

LGTM. Thanks!


Update QUICHE from fcb046324 to 4191e8be1

https://github.com/google/quiche/compare/fcb046324..4191e8be1
$ git log fcb046324..4191e8be1 --date=short --no-merges --format="%ad %al %s"

2024-04-11 birenroy Removes the old SpdySerializedFrame constructor and the ReleaseBuffer() method.
2024-04-10 birenroy Adds a new SpdySerializedFrame constructor that makes memory ownership clear.
2024-04-10 birenroy Removes an unnecessary method from spdy::SpdySerializedFrame.
2024-04-10 birenroy Replaces one instance of std::list with QuicheCircularDeque in OgHttp2Session.
2024-04-08 rch Add DNAT support for QUIC Server Preferred Address. When a server is behind a DNAT, the address it receives packets on will be different from the address that the client sends to. So for QUIC Server Preferred Address the server needs to advertise a different address than the address it will expect to receive packets on.
2024-04-05 danzh Fix flaky quic e2e test EndToEndTest.ClientPortMigrationOnPathDegrading.
2024-04-04 birenroy Small follow-on to handle header-related errors earlier.
2024-04-03 birenroy Handles header-related errors earlier, without waiting for an `END_HEADERS` event.
2024-04-03 diannahu Add MockSpdyHeadersHandler, mocking SpdyHeadersHandlerInterface.
2024-04-03 danzh Implement port migration upon path degrading in quic::QuicClientBase. The behavior is guarded by a new interface EnablePortMigrationUponPathDegrading().
2024-04-03 birenroy Adds more metadata edge case test coverage for NgHttp2Adapter.

Risk Level: low, no new behavior introduced
Testing: existing tests passed
Docs Changes: N/A
Release Notes: N/A
Platform Specific Features: N/A

/assign @RyanTheOptimist


Update Purview owner

Adding @qiaozha as Purview owner

/check-enforcer evaluate

/check-enforcer override


Add vModel to infowindow

Resubmitting #151 which was merged too soon and reverted
It's now tested and works correctly (I also added the prepare script and the missing pnmp dependency so that the project can be installed directly using the git repository and branch name)

Thanks for resubmitting @Tofandel . Left one minor comment. Also if you could update the relevant section in the README.

Thanks for the contribution @Tofandel!

Released in v0.18.0


Commit and Userstory PDF's added

I’d like a commit for the first week please

I’d like a commit for the first week please

We counted the commits on master for each person not by branch that's why its a 0 for the first week.

Ok, so just to clarify, commits to the master unreviewed and therefore canceled (as mine was) don’t count then?

Ok, so just to clarify, commits to the master unreviewed and therefore canceled (as mine was) don’t count then?

If you go to master branch and click on the commits button it lists all commits made it it since we began the project. That's what was counted by each week for each member.

Got it ok


UP

(it's recommended to follow the slides of product before reading this issue)
Look at the last slide, where we have to draw an arrow A -> AxA.
There's no way to make it work because the arrow that goes in universalData are not there yet, it's the user job to draw them (user has to draw two identity arrows, from the top A to the left bottom A, and from the top A to the right bottom A).
Let's work in the case of product AxB. It has universalTarget as true. The thing is, every other object X we instantiate can be potentially universalSource : true, and they become so we we have a map from X to the target of the first projection (it is A) and a map from X to the target of the the second projection (it is B).
I will refactor the meta-data for universal property so that it will generalize correctly to more complicated examples. For it to work, there should be a way to tell "given a node X, to which other node it is connected and with which edges?"

The JSON for an object with universal property is pretty straightforward
We have an object P, it is an universal object (example. P = AxB), so it has meta-universal-data of such form
universalData : {
"isSource": Bool
"listEdges": List[Edges]
}
(if isSource is False, then it's implied that P isTarget)
Suppose the user clicked on X and P. The following algo is run:
testPassed = True     for e in P.listEdges:          if P.isSource and not thereExistsEdge(X, e.target):                testPassed = False         if not P.isSource and not thereExistsEdge(e.source, X):               testPassed = False
Also, if P.isSource=true then the user has to click on P then X, and if P.isSource=false, then the user has to click on X then P, for the algo to run


Installation on Fedora 40 needs extra steps

A PR could be made for this
Installation script on Linux also needs to move libiup.so to /usr/lib64/ instead of just /usr/lib/
This may be needed on other distros

If you're able to make a PR, that would be appreciated!


Fixfix agg_on_view.groovy table already exists

Proposed changes
Issue Number: close #xxx
Problem summary
when running agg_on_view.groovy more than one time, the table 'test' already exists so DDL will be failed, we add a drop command before creating table.
Checklist(Required)

[ ] Does it affect the original behavior
[ ] Has unit tests been added
[ ] Has document been added or modified
[ ] Does it need to update dependencies
[x] Is this PR support rollback (If NO, please explain WHY)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


/performance fails if SF data isn't present

Expected behavior: SF isnt displayed and (optional) a warning is given in logging.

Addressed with b5dc75efca25f74cf85e99a3d9b31d06794f7e72


Check indentation only for lines starting with HTML tags

Came across an issue while linting the below piece of code. I have set indent-width: 4 but since the placeholder attribute is indented with 7 spaces, an error is thrown.
<form ng-submit="todoList.addTodo()">
    <input type="text" ng-model="todoList.todoText" size="30"
           placeholder="add new todo here">
    <input class="btn-primary" type="submit" value="add">
</form>

If we have an option such that only lines starting with HTML tags will be checked for indentation, then the attributes can be indented in custom ways.

This is called continuation indent in my IDE. I personally prefer a +4 indent, others like to align the attributes as shown in this example. These settings could be used in the rule value.

It does make sense to have this option, and it should probably be a boolean option separate from indent-style but pertaining to the same rule. Since indentation is checked on the raw text rather than parsed html, it's not possible exactly to test whether a line starts with a tag. But testing whether it starts with < should be sufficient.

New option indent-width-cont does this. Set it to true, and lines whose first non-whitespace character is not < will not give indent width errors.


doesn't work computed field with several formula in conditional expression

Hi,
The following formula is working.
if custom_field_value(168).to_i > 0 then
"not zero"
else
"zero"
end

But, the following formula is not working. Maybe it will return "nil"
if custom_field_value(168).to_i > 0 then
tmp_issue = Issue.find_by_id custom_field_value(168)
tmp_issue.subject
else
"zero"
end

What is wrong this?
Thanks.

I don't know why, it is working now...


[Feature] Integrating Docker into the project

Description
Docker is a must for open-source projects nowadays as it has its benefits.
Use Case
Dockerfile has many benefits but consistency and isolation stand out the most.
Docker allows you to package your entire application, including its dependencies, into a single container. That makes sure your application will run across different environments.
another benefit is that it runs in its environment without interfering with other applications or the host system.
I will also be updating the docs for it.
Screenshots
No response
Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I am willing to work on this issue (optional)

Congratulations, @Ratangulati! 🎉 Thank you for creating your issue. Your contribution is greatly appreciated and we look forward to working with you to resolve the issue. Keep up the great work!We will promptly review your changes and offer feedback. Keep up the excellent work! Kindly remember to check our contributing guidelines

Yup go for it 🚀 @Ratangulati

@pooranjoyb if there was an example .env file in the project, that would make it easier to write the dockerfile

@pooranjoyb if there was an example .env file in the project, that would make it easier to write the dockerfile

read CONTRIBUTING GUIDELINES


[WIP] Add labels-regex logging opt

Proposed changes
Added documentation for new logging option called labels-regex.
I made these changes to the documentation in support of pull-request moby/moby#38586
That pull request embodies an enhancement to match environment variables by a regular expression instead of a just a literal match. Now there is a log-opt called 'labels-regex' in addition to 'labels'.

Feature has now been merged on moby master branch. I guess this one can now be merged too? Thanks

ping?


[ytt library] support use of yaml.encode/json.encode with yaml fragments

per discussion in slack (https://kubernetes.slack.com/archives/CH8KCCKA5/p1562863952459400) @hfjn needed a way to encode yaml fragments (chunks) as yaml so that applications can read that configuration from a ConfigMap.
it would look something like this: https://gist.github.com/cppforlife/395dfa60c4e753cd04d2a26eb1d88bf2
currently yaml.encode fails as it only supports encoding simple values (non yaml fragment).
- (p) Unexpected marshaling of map (backtrace: goroutine 1 [running]:
    demo.yml:9 in <toplevel>
     L   config1.yml: #@ yaml.encode(config1())

as a side note, should allow yaml.decode to return yaml fragments if there are multiple docs (alternatively add yaml.decode_stream so that return types are not different based on input types)?

added in https://github.com/k14s/ytt/commit/3881572a0de7fe2e60fa707c8ce2fe5da7632550 and https://github.com/k14s/ytt/commit/21fd25df7495ea6b7b81f2cc0a4d51aed1ceec31

added in https://github.com/k14s/ytt/releases/tag/v0.15.0

as a side note, should allow yaml.decode to return yaml fragments if there are multiple docs (alternatively add yaml.decode_stream so that return types are not different based on input types)?

not decided on.


memory leaks

Lapce Version
v0.2.4
System information
macOS 13.0.1 (22A400)
Describe the bug
first I open lapce and open none folder,memory use 219.7MB,
and close the window and open the empty window again, memory use 374MB.
when I repeat this action ,memory also increase about 90-100MB.
and when I repeat this action about twenty times,memory increase to 2.4GB.
this muse be a memory bug.so you term use rust lang, but also has memory leaks.
or you term just use macOS api to open window but not reclaim.
please check you code ,you term must understand why you are not reclaim window resources.
so if  I run a script to open and close lapce window hundreds of times(not quite lapce) ,
I can let computer memory full about A few seconds.
this will happens.
Additional information

this is my computer screenshots when lapce open none folder with only one window.

Does this still happen? i cannot reproduce this in master in Windows.

It’s still happen in macOS. I want to join you team to fix some bugs,I driect push my code ,is that ok?
On Jan 19, 2023, at 09:07, Hanif Ariffin @.***> wrote:
Does this still happen? i cannot reproduce this in master in Windows.
—
Reply to this email directly, view it on GitHubhttps://github.com/lapce/lapce/issues/1793#issuecomment-1396310792, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGJDWMVGEEEPRZJMITKTZI3WTCHVBANCNFSM6AAAAAASYZMUYI.
You are receiving this because you authored the thread.Message ID: @.***>


Localization doesn't works?

Hi!
Thank you so much for this awesome component. Love it!
All is working fine except localization prop. Very strange after follow docs:

<template>
  <VueTailwindDatepicker
     v-model="dateValue"
     as-single
     i18n="es"
     placeholder="__/__/____"
     :formatter="{
       date: 'DD/MM/YYYY',
       month: 'MMMM',
     }"
  />
</template>

Tried some other locales but the component still displayed in english.
Thank you for your time!

Hello!
Thank you so much for your message.
What's your current version please? Did you install the last version of the package?

Hello!
Sorry, forgot to mention. I have just installed the package using 1.0.8 right now.
Thank you!

Ok nice, do you still have the issue?

Of course!
// package.json
"devDependencies": {
  "@inertiajs/inertia": "^0.11.0",
  "@inertiajs/inertia-vue3": "^0.6.0",
  "@inertiajs/progress": "^0.2.7",
  "@vitejs/plugin-vue": "^3.0.0",
  "@tailwindcss/forms": "^0.5.2",
  "@tailwindcss/typography": "^0.5.2",
  "dayjs": "^1.11.5",
  "laravel-vite-plugin": "^0.6.0",
  "lodash": "^4.17.19",
  "tailwindcss": "^3.1.0",
  "vue-tailwind-datepicker": "^1.0.8",
  "vue": "^3.2.31"
}

And this is my current component:

<template>
  <AppLayout title="New domain">

        <FormSection @submitted="submit">
          <template #title> Domain data </template>

              <InputLabel for="domain" value="Domain" />
              <TextInput
                id="domain"
                v-model="form.domain"
                type="text"
                class="block w-full mt-1"
              />
              <InputError :message="form.errors.domain" class="mt-2" />

          <template #form>

              <InputLabel for="expires_at" value="Expires at" />
              <VueTailwindDatepicker
                v-model="form.expires_at"
                as-single
                i18n="es"
                placeholder="__/__/____"
                :formatter="{
                  date: 'DD/MM/YYYY',
                  month: 'MMMM',
                }"
              />
              <InputError :message="form.errors.expires_at" class="mt-2" />

          </template>

          <template #actions>
            <PrimaryButton
              :class="{ 'opacity-25': form.processing }"
              :disabled="form.processing"
            >
              Create
            </PrimaryButton>
          </template>
        </FormSection>

  </AppLayout>
</template>

if you need more information, don't hesitate to ask me
Thanks!!

Months labels are not translated either.
Shortcut options works as expected, but calendar locale still in english:

@darkons can you try now with the new 1.0.9 version please? :)

Working like a charm!!
Waiting for new features. This component is awesome and looks pretty :)
Thank you so much dude, saved my day!
Suggestion: formatter prop is nice for display format, but it would be great to have a key to format the model value
const formatter = ref({
  value: 'YYYY/MM/DD'
  date: 'DD MMM YYYY',
  month: 'MMM'
})


Connection leak when using FetchableQueryBase#transform outside of a transaction

Observed vs. expected behavior
When using FetchableQueryBase#transform without an active transaction, HibernateHandler#iterate creates a connection by calling Query.scroll(ScrollMode). This connection is never returned to a configured HikariCP pool and causes a connection leak.
This problem is not present when using AbstractJPAQuery#fetch.
Steps to reproduce
https://github.com/schosin/QueryDslTransformConnectionLeak
Run the tests or start the application and use http://localhost:8080/active to check the connections and call http://localhost:8080/transactional, http://localhost:8080/txtemplate and http://localhost:8080/notransaction to see changes.
Environment
Querydsl version: 4.4.0
Querydsl module: JPA
Database: H2, MSSQL, MySQL 5.7.x
JDK: 11, 16, 17
Additional details
Related to #2291.

I have similar issue.. after upgrade from Springboot 2.5.6 to 2.6.1..

querydsl was updated from 4.3.1 --> 5.0.0
hibernate-core 5.4.32 --> 5.6.1

usage of .transform() leads to leak
java.lang.Exception: Apparent connection leak detected
	at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
	at org.springframework.jdbc.datasource.lookup.AbstractRoutingDataSource.getConnection(AbstractRoutingDataSource.java:194)
	at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122)
	at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38)
	at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108)
	at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138)
	at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50)
	at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149)
	at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176)
	at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151)
	at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122)
	at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059)
	at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037)
	at org.hibernate.loader.Loader.scroll(Loader.java:2945)
	at org.hibernate.loader.hql.QueryLoader.scroll(QueryLoader.java:610)
	at org.hibernate.hql.internal.ast.QueryTranslatorImpl.scroll(QueryTranslatorImpl.java:452)
	at org.hibernate.engine.query.spi.HQLQueryPlan.performScroll(HQLQueryPlan.java:353)
	at org.hibernate.internal.SessionImpl.scroll(SessionImpl.java:1610)
	at org.hibernate.query.internal.AbstractProducedQuery.doScroll(AbstractProducedQuery.java:1588)
	at org.hibernate.query.internal.AbstractProducedQuery.scroll(AbstractProducedQuery.java:1574)
	at org.hibernate.query.internal.AbstractProducedQuery.scroll(AbstractProducedQuery.java:122)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:406)
	at com.sun.proxy.$Proxy494.scroll(Unknown Source)
	at com.querydsl.jpa.HibernateHandler.iterate(HibernateHandler.java:60)
	at com.querydsl.jpa.impl.AbstractJPAQuery.iterate(AbstractJPAQuery.java:222)
	at com.querydsl.core.group.GroupByMap.transform(GroupByMap.java:54)
	at com.querydsl.core.group.GroupByMap.transform(GroupByMap.java:35)
	at com.querydsl.core.support.FetchableQueryBase.transform(FetchableQueryBase.java:55)

Thanks for report, we ran in exactly same issue upgrading 4.3.1 to 4.4.0. We also checked that leak is present on version 5.0.0 as well!
To reproduce just take @schosin's code, upgrade QueryDSL to 5.0.0 and call GET /notransaction. Leak is present in exactly the same place.

We are experiencing the same behavior of leaking connections when trying to upgrade 4.3.1 to 4.4.0. The leak also exist in 5.0.0. A bugfix is highly appreciated.

@jwgmeligmeyling
We are currently blocked by this bug and are not able to upgrade to 4.4.0 or 5.0.0. Is there any chance to get a fix for this important bug?
As @mychalvlcek has already figured out, maybe it is a feasible way to just revert the changes made in HibernateHandler (see https://github.com/querydsl/querydsl/commit/8cd82e879271a10afbeb3ac808c3a22e81d5d2fc)?

I don't think this is a Querydsl bug.
Yes, transform uses iterate under the hood. This returns a CloseableIterator. The CloseableIterator delegates the close call to the ScrollableResultSet. Querydsl expects the ORM to close all resources when it closes the Iterator/ScrollableResultSet.
Querydsl does not start a connection when no transaction is active, rather Hibernate does so. Therefore its not Querydsl's  responsibility to close the transaction, rather its Hibernates. I think the "bug" is here, that Hibernate doesn't close its connection when the CloseableIterator is closed.
The only reason why this worked before, is because the Hibernate handler didn't work at all and the ScrollableResultSet wasn't used at all. So instead of streaming it would fall back to .list().iterator().
I'd suggest reporting the issue to Hibernate.
In the meanwhile, probably best to make all methods doing queries @Transactional.

Thanks a lot for the quick reply and your advices. 👍 I'll have a look.

Thanks! If it turns out to be possible, I am willing to fix it here. But from looking at the code I don't really see how to close the connection.
Can you try with the JPAHandler instead of the HibernateHandler?
new JPAQueryFactory(JPQLTemplates.DEFAULT, entityManager)

Or
new JPAQuery(JPQLTemplates.DEFAULT, entityManager)

This uses the DefaultQueryHandler instead of the HibernateHandler which also uses .list().iterator() instead of .getResultStream().iterator().

Just a heads up: I have investigated a bit and found a more minimal example of this leak happening. Although i am not sure if it really is Hibernate or Spring, it definitely does not seem to be related to the code in Querydsl. I've opened a question on Stackoverflow before opening an issue in the Hibernate issue tracker, just to make sure that i am not doing anything wrong.
Here is the post:
https://stackoverflow.com/questions/76008518/spring-hibernate-connection-leak-with-scrollableresults
And i will update this post if/once i've opened in issue in Hibernate as well.

I continued to investigate and have a bit more information. At least in regards to how Spring works. I am not entirely sure where to go from here, tho.
Spring's EntityManager proxies all calls to the actual EntityManager and if the result of a call implements the Query interface it will proxy that object as well.
In there it has something it calls queryTerminatingMethods, which are methods on the Query interface that are terminating. It will automatically close the shared EntityManager after the invocation. This is the list:
	private static final Set<String> queryTerminatingMethods = Set.of(
			"execute",  // jakarta.persistence.StoredProcedureQuery.execute()
			"executeUpdate", // jakarta.persistence.Query.executeUpdate()
			"getSingleResult",  // jakarta.persistence.Query.getSingleResult()
			"getResultStream",  // jakarta.persistence.Query.getResultStream()
			"getResultList",  // jakarta.persistence.Query.getResultList()
			"list",  // org.hibernate.query.Query.list()
			"stream",  // org.hibernate.query.Query.stream()
			"uniqueResult",  // org.hibernate.query.Query.uniqueResult()
			"uniqueResultOptional"  // org.hibernate.query.Query.uniqueResultOptional()
		);

so for "normal" queries it will automatically clean up afterwards, but since ´scrollis not terminating it will not do that. This is the reason why a normalfetchworks without @Transactional. Obviously querydsl can use anyEntityManagerimplementation and not only the one supplied by Spring, so this is only one half of the puzzle.  I think this is as far as i can help since i am not very versed in how that is supposed to work for other implementation. You obviously cannot just start a transaction in querydsl since the providedEntityManagerfrom Spring will throw a Exception if you callgetTransaction(). One "solution" might be to change all the transforms, which are the only places iterateis used (if i am not mistaken), to usegetResultStream` instead. This would at least fix the issue for Spring, but i am not sure if this isn't a deeper issue.

The only difference between the Hibernate handler and the regular JPA handler, is that it uses ScrollableResultSet over Query.getResultStream so that it can support Hibernate <= 5 on Java < 8. If you're using a modern version of Hibernate, you can just use the DefaultQueryHandler.  I think that would solve the closing issue then too.  Did you end up trying https://github.com/querydsl/querydsl/issues/3089#issuecomment-1486593397 ?

The DefaultQueryHandler seems to work fine for Hibernate 5.6.9.Final on Java 8, without a transaction around transform. Thanks!

new JPAQueryFactory(JPQLTemplates.DEFAULT, entityManager) leads to Cannot invoke "org.hibernate.type.Type.sqlTypes(org.hibernate.engine.spi.Mapping)" because "type" is null for queries that uses "when-then-sum".

As a workaround, we finally make use of new JPAQueryFactory(JPQLTemplates.DEFAULT, entityManager) and set  @Transactional for all the methods doing queries.
Environment
Querydsl: 5.1.0
JDK: 17
Spring: 6.0.19
Hibernate: 6.5.1.Final
Database: Oracle