Best practice for handling replicates and associated statistics

I'm curious as to what would be the best practice for this situation...
I have an np.array containing 18 expression values for gene y. There are 3 replicates, so 6 different conditions.
adata.X[:,0] = [ 72.  92.  51.  93.   1.  46.   0.  33.  46.  75.  56.  28.  90. 100.  7.  25.  40.  81.]
I need to calculate several values: replicate average, pvalue, FDR, standard error and standard deviation.
Currently, I can calculate average for the replicates. The result for the above example is:
adata.Xmean[:,0] = [71.6667 71.6667 71.6667 46.6667 46.6667 46.6667 26.3333 26.3333 26.3333 53.  53.  53.  65.6667 65.6667 65.6667 48.6667 48.6667 48.6667]
This seems redundant as the average is listed for each replicate. It led me to think about separating the replicates into their own .X, like .X1 for replicate 1, .X2, etc. This would mean the .Xmean[0] would link to .X1[0], .X2[0], .X3[0].
The averages may be the only one to benefit from this setup, as each replicate will have its' own p-value, FDR, standard error, and standard deviation.  This makes me think the redundant .Xmean is the better approach.
What are your thoughts? Thank you in advance!

I think it shows us some strategy, yes.  I can't claim to understand what each line you did there does but I have a notebook open now and am trying to step through it.  I think part of the issue here is we're wanting to store aggregate values like means within adata so that they don't have to be recomputed every time they are needed.  Web interfaces are being driven off these files, so rapid access is preferred over storage concerns.
If, in the example of datasets with technical replicates, we almost always are only interested in the mean values across replicates.  So if our input is like this:

Simple demo with 4 genes, 2 conditions, and 3 replicates of each condition.  Does one make this exact matrix adata.X?

Or should the means be calculated and stored as adata.X with individual replicates stored as separate matrices of the same size, like adata.uns['rep1'], adata.uns['rep2'], ... etc.  This is specifically the part I was asking about regarding conventions, as it seems there must already be a convention for storing technical replicates and their aggregate values (mean, stddev, etc.)
I think the examples given with values like 0 and 1 are a bit confusing because I can't tell if you're using that as a proxy for column names or are they index positions?


Meteor.unsubscribe() not working.

my requirement is like i want to unsubscribe and subscribe on the flow.

Always try to connect, and through an error "Swift ddp connection closed with error 1000, clean true "
and in loop try to connect -> again fail->again subscription fail....

Can you share the code you're trying to run to connect and subscribe?

I have a code given below. Once error come "Swift ddp connection closed with error 1000, clean true " it tries to reconnect  , So calls Meteor.connect but fail to subscribe and shows "already subscribed" and same cycle repeats. Also I don't get any updates from server. And also I am not getting any 'pong' messages. I am new at swift so it may be my implementation mistake. Thanking you in anticipation.
although i am having god network connection, it gives me error periodically.
`func connectToServer(collectionId: String) -> Bool {
Meteor.connect(Config.URL) {
self.subscribe(collectionId)
}
return true
}
private func subscribe(collectionId : String) {
    Meteor.subscribe("collection name" , params: [collectionId]) {
        self.collectionId = collectionId
        self.collectionSubscriptionIsReady("connected")
    }
}

private func collectionSubscriptionIsReady(result : String) {
    print("Subscribed to collectoin ");
    delagate?.connected(result)
}`

I don't see anything obviously wrong, but you're wrapping all of the Meteor methods in your own class, and I wonder how you're using that class.

First, have you enabled logging?  swift Meteor.client.logLevel = .Debug before you connect. That would enable you to see pongs, as well as other debug messages.
Where are you making your connection and subscription? You should only do this once in the app, and doing this in your AppDelegate is a good place to do it.

I have one app in which I need to subscribe to the one collection with specific ID as like mahadevTW's code.
If user want to open another data set in same collection with different ID, So we need to subscribe to the another Data Set from the same collection. So I need to unsubscribe and again resubscribe to the same collection with new ID.
Once reconnection is done it shows "Swift ddp connection closed with error 1000, clean true "  and it will again subscribe and the cycle continues.
Due to different ID I need to call subscribe multiple times , which leads to previous error "connection closed"
My Server side code of publish is as follows :
Meteor.publish('mindmap', function (id) {    return Mindmaps.find({$or:[{_id:id},{rootId:id}]}); });
And subscribe code is similar to MahadevTW.
So Is their be any appropriate way to resubscribe  to the same collection with different parameters.

Thanks @SwapnilBGaikwad and @mahadevTW . I haven't encountered this issue before. I think there's an issue here, but it's tough to say what the issue is without being able to run the code. Would it be possible for one or both of you create a github repo with code that reproduces this issue?

I have created the repo on git hub which will shows the above connection closed error.
Here is the link of git hub repo.
https://github.com/SwapnilBGaikwad/SampleSwiftDDPCode.git
So please tell me proper way to deal with such situation in which I need to
subscribe to the collection with the same collection name but with different collection id.

@SwapnilBGaikwad
I see now what you are doing.
Please see the todos example. It illustrates exactly what you are trying to do.
The short answer is: handle your subscription when you instantiate your view controller. Unsubscribe to the subscription when it will disappear. viewWillDisappear is a good place to do this, as shown in the example.
Second, and importantly, you should only instantiate Meteor once, and this should probably be done in your app delegate. Again, see the example. You are trying to reconnect each time the user moves to MapTableViewController via your MeteorTracker class that wraps Meteor. This is wrong. So, one connection per app session.
I would get rid of the MeteorTracker class. Unless you instantiate MeteorTracker in AppDelegate, and remove the subscription logic from it, you really can't handle the subscriptions correctly. And if you do that, it's not doing much as a wrapper.
Finally, I ran your code for about 15 minutes, in several sessions and didn't get the "Swift ddp connection closed with error 1000, clean true ."

Thank you for your suggest I have implemented in my app and seems to be working fine.
But now I need to open my app from using custom URL scheme.
So when I opened for first time and subscribed and pressed home then try to open the app with new subscription parameter (id) passed in URL. So it says already subscribed and new subscription fails as expected.
In this condition ,  is their be any way to reset the things that are already subscribed when entered in AppDelegate method :
func application(app: UIApplication, openURL url: NSURL, options: [String : AnyObject]) -> Bool

I'm not sure I understand what you're trying to do. The way to reset a subscription is to unsubscribe from the publication.

If I opened app and subscribed with specific subscription parameter (id).
Now my app is connected and subscribed state.
In my app I am unsubscribing the collection in viewWillDisappear.
If subscription is done app and user then open app using URL scheme
e.g. myapp://id
then it simple say already subscribed as expected.
So I need to know in such a condition how to unsubscribe to collection.
If I unsubscribe when app goes in background then user will not get updates when user open the app present in background.

In this instance, I think the appropriate action is to unsubscribe and then resubscribe. Unsubscribe from your publications when the app will enter the background, and resubscribe when when the app becomes active again.

I have implement the app with functionality of opening app through URL. So when user clicks the like app open's the mindmap.
But their are some issues in it.
My server side Website is www.mindit.xyz. User can subscribe to collection with root Id of mindmap and server will only publish only part of mindmap collection.
Here is the link of my repo:
https://github.com/Allminds/mind-it-ios.git
So please tell what is going wrong in the app.
Subscription Cycle
TableViewController
viewWillAppear -> Subscribe
viewDidDisappear -> unSubscribe
applicationDidEnterBackground -> Subscribe
applicationDidBecomeActive -> Unsubscribe
Issues
Collection get unsubscribed while opening app thought URL.
Check the log which will show the above error.

Your suggestion really helped me to resolve all of the error.
Thanks for your support.
:+1:


moveit_ros_control_interface failed with colcon build --mixin release

Description
I'm trying to do the basic tutorial of Moveit2 humble. I have followed all the procedures of the Getting Started but moveit_ros_control_interface ifailed
Your environment

ROS Distro: Humble
OS Version: Ubuntu 22.04
Source binary
If binary, which release version?
If source, which git commit or tag?

Steps to reproduce
https://moveit.picknik.ai/humble/doc/tutorials/getting_started/getting_started.html
Uninstalled ROS 2 Humble, deleted every dir created also in opt.
Reinstalled, and get to this tutorial
Expected behaviour
It should compile with colcon build --mixin release, instead it gave me error on a packace
Backtrace or Console output
rosdev@rosdev:~/ws_moveit2/src$ source /opt/ros/humble/setup.bash
rosdev@rosdev:~/ws_moveit2/src$ colcon build --mixin release
[0.466s] WARNING:colcon.colcon_core.package_selection:Some selected packages are already built in one or more underlay workspaces:
	'hardware_interface' is in: /opt/ros/humble
	'controller_interface' is in: /opt/ros/humble
If a package in a merged underlay workspace is overridden and it installs headers, then all packages in the overlay must sort their include directories by workspace order. Failure to do so may result in build failures or undefined behavior at run time.
If the overridden package is used by another package in any underlay, then the overriding package in the overlay must be API and ABI compatible or undefined behavior at run time may occur.

If you understand the risks and want to override a package anyways, add the following to the command line:
	--allow-overriding controller_interface hardware_interface

This may be promoted to an error in a future release of colcon-override-check.
Starting >>> moveit_common
Starting >>> moveit_resources_panda_description
Starting >>> moveit_configs_utils
Starting >>> moveit_resources_fanuc_description
Starting >>> controller_manager_msgs
Starting >>> ros2_control_test_assets
Starting >>> moveit_task_constructor_msgs
Starting >>> rviz_marker_tools
Finished <<< moveit_common [1.09s]
Starting >>> moveit_resources_pr2_description
Finished <<< moveit_configs_utils [1.10s]
Finished <<< moveit_resources_panda_description [1.12s]
Starting >>> moveit_resources_prbt_support
Starting >>> moveit_resources_panda_moveit_config
Finished <<< moveit_resources_fanuc_description [1.18s]
Starting >>> moveit_resources_fanuc_moveit_config
Finished <<< ros2_control_test_assets [1.82s]
Starting >>> hardware_interface
Finished <<< moveit_resources_prbt_support [0.87s]
Starting >>> joint_limits
Finished <<< moveit_resources_panda_moveit_config [0.91s]
Finished <<< moveit_resources_pr2_description [0.96s]
Starting >>> rviz_visual_tools
Starting >>> moveit_core
Finished <<< moveit_resources_fanuc_moveit_config [0.88s]
Starting >>> rosparam_shortcuts
[Processing: controller_manager_msgs, hardware_interface, joint_limits, moveit_core, moveit_task_constructor_msgs, rosparam_shortcuts, rviz_marker_tools, rviz_visual_tools]
Finished <<< rviz_marker_tools [39.7s]
Starting >>> moveit_resources
Finished <<< joint_limits [37.8s]
Finished <<< controller_manager_msgs [40.1s]
Finished <<< moveit_resources [0.91s]
Finished <<< moveit_task_constructor_msgs [45.5s]
Finished <<< rosparam_shortcuts [45.8s]
[Processing: hardware_interface, moveit_core, rviz_visual_tools]
Finished <<< rviz_visual_tools [1min 22s]
Finished <<< hardware_interface [1min 26s]
Starting >>> controller_interface
Starting >>> transmission_interface
[Processing: controller_interface, moveit_core, transmission_interface]
Finished <<< controller_interface [37.1s]
Starting >>> controller_manager
Finished <<< transmission_interface [47.0s]
[Processing: controller_manager, moveit_core]
Finished <<< controller_manager [1min 4s]
Starting >>> ros2controlcli
Finished <<< ros2controlcli [1.08s]
Starting >>> ros2_control
Finished <<< ros2_control [0.86s]
[Processing: moveit_core]
[Processing: moveit_core]
Finished <<< moveit_core [4min 29s]
Starting >>> moveit_ros_occupancy_map_monitor
Starting >>> moveit_simple_controller_manager
Starting >>> moveit_resources_prbt_ikfast_manipulator_plugin
Starting >>> chomp_motion_planner
Starting >>> pilz_industrial_motion_planner_testutils
Finished <<< moveit_simple_controller_manager [22.1s]
Starting >>> moveit_plugins
Starting >>> moveit_ros_control_interface
Finished <<< moveit_plugins [0.88s]
Finished <<< pilz_industrial_motion_planner_testutils [27.1s]
Finished <<< chomp_motion_planner [34.9s]
Starting >>> moveit_chomp_optimizer_adapter
Starting >>> moveit_planners_chomp
Finished <<< moveit_resources_prbt_ikfast_manipulator_plugin [38.1s]
--- stderr: moveit_ros_control_interface
/home/rosdev/ws_moveit2/src/moveit2/moveit_plugins/moveit_ros_control_interface/src/controller_manager_plugin.cpp: In member function ‘bool moveit_ros_control_interface::MoveItControllerManager::fixChainedControllers(std::shared_ptr<controller_manager_msgs::srv::ListControllers_Response_<std::allocator<void> > >&)’:
/home/rosdev/ws_moveit2/src/moveit2/moveit_plugins/moveit_ros_control_interface/src/controller_manager_plugin.cpp:471:22: error: ‘struct controller_manager_msgs::msg::ControllerState_<std::allocator<void> >’ has no member named ‘chain_connections’
  471 |       if (controller.chain_connections.size() > 1)
      |                      ^~~~~~~~~~~~~~~~~
/home/rosdev/ws_moveit2/src/moveit2/moveit_plugins/moveit_ros_control_interface/src/controller_manager_plugin.cpp:478:56: error: ‘struct controller_manager_msgs::msg::ControllerState_<std::allocator<void> >’ has no member named ‘chain_connections’
  478 |       for (const auto& chained_controller : controller.chain_connections)
      |                                                        ^~~~~~~~~~~~~~~~~
gmake[2]: *** [CMakeFiles/moveit_ros_control_interface_plugin.dir/build.make:76: CMakeFiles/moveit_ros_control_interface_plugin.dir/src/controller_manager_plugin.cpp.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:143: CMakeFiles/moveit_ros_control_interface_plugin.dir/all] Error 2
gmake[1]: *** Waiting for unfinished jobs....
gmake: *** [Makefile:146: all] Error 2
---
Failed   <<< moveit_ros_control_interface [16.3s, exited with code 2]
Aborted  <<< moveit_planners_chomp [3.68s]
Aborted  <<< moveit_chomp_optimizer_adapter [3.75s]
Aborted  <<< moveit_ros_occupancy_map_monitor [39.0s]

Summary: 28 packages finished [5min 10s]
  1 package failed: moveit_ros_control_interface
  3 packages aborted: moveit_chomp_optimizer_adapter moveit_planners_chomp moveit_ros_occupancy_map_monitor
  1 package had stderr output: moveit_ros_control_interface
  31 packages not processed

please someone tells me what's wrong, it's been a day i'm waisting time trying to solve this bug but i think is something above me.
Please, someone help me!

non funziona una minchia!!!

Please be polite.
I think the cause was this commit:  https://github.com/ros-planning/moveit2/pull/1482
Maybe the change it depends on in ros2_control was not released for Humble yet.
As a temporary fix, while waiting, you could roll the state of moveit2 back to prior to that commit.
cd moveit2
git reset --hard 337416de7cbfbb58f151f16edd4f8c0f36e5faf8

You can also make sure your other ros2 packages are up-to-date.
sudo apt update
sudo apt upgrade

Hi @AndyZe ,
i've seen that build farm is completely right, but i uninstalled ROS2 (also every file produced) and installed from scratch, same process adopted with moveit2 from the tutorial and still it doesn't work.
Also updated and upgraded my version using apt.
i can't figure it out why it's giving me errors in a .cpp file inside code. It tells one variable is missing of a parameter. I don't think i should manually change something by myself but also i'm confused on what to do. Also remake everything from scratch again.
Thank you for your help!
Enrico

Also, note that the buildfarm does not have any problem with Humble. This is an indication that the issue is on your end, I'm sorry to say:
https://github.com/ros-planning/moveit2#buildfarm
Hi @AndyZe,
i've just created a fresh built ubuntu 22.04 virtual machine running on VMWare, installed all packages with sudo apt update && sudo apt upgrade, i've installed everything from scratch: ROS2 Humble source following with attention the official guide http://docs.ros.org.ros.informatik.uni-freiburg.de/en/humble/Installation/Ubuntu-Install-Debians.html and then proceeded with Moveit installation from https://moveit.picknik.ai/humble/doc/tutorials/getting_started/getting_started.html.
Followed every passage described here but it gave me same error as before in the same with same package. Maybe i have something missing on my basic setup, but i'm not sure to have many problems about it.

Thank you again, Enrico

I had the same issue awhile back.  Per the "Getting Started" instructions, vcs import is run with https://github.com/ros-planning/moveit2_tutorials/blob/main/moveit2_tutorials.repos which checks out version 2.12.1 of ros2_control which has an older ControllerState msg (i.e., doesn't have chain_connections field).
Checking out 2.14.0 (i.e., humble) should get the updated message description and fix the issue.  Perhaps the vcs repo file wasn't updated with https://github.com/ros-planning/moveit2/pull/1482 that Andy mentioned.
$ cd ws_moveit/src/ros2_control
$ git fetch origin humble
$ git checkout humble
$ cd ../..
$ colcon build --mixin release

hi @BrettHemes,
thank you very much for the help.
Now i've made git reset hard as mentioned by @AndyZe  and worked fine (for my purpose), i will try it next days and confirm your suggestions.
Thanks a lot for your help,
Enrico

I'm getting the same behaviour using the Docker install (https://moveit.picknik.ai/humble/doc/how_to_guides/how_to_setup_docker_containers_in_ubuntu.html), but I solved following BrettHemes instructions.


[13pt] PR: Create inundation process for ras2fim #29

This pull request includes additions and modifications to the existing ras2fim / ras2rem workflow that creates output files that can be fed directly into inundation.py.
Additions

ras2catchments.py: creates COMID catchments as a raster (tif) and polygons (gpkg) for use with discharge / stage lookup. The inputs to the main function are input and output directories (input: location of step 5 ras2fim files where all the depth grid files live, output: location of ras2rem files [or anywhere else of user's choosing, if they don't want the resulting COMID raster and polygon files to be with the ras2rem outputs])
ras2inundation.py: copy of inundation.py script that can be modified for ras2fim as necessary if separate needs arise from HAND-based modeling

Changes

ras2rem.py: Modifications to synthetic rating curve (SRC) generation to ensure we have the necessary fields for inundation.py to work, consistent with HAND-based hydro tables. Specifically adds or modifies the following columns:

HydroID (added as copy of feature_id)
HUC (added)
LakeID (added as -999)
last_updated (added as empty string)
submitter (added as empty string)
obs_source (added as empty string)
AvgDepth (m) renamed to stage
Flow (cms) renamed to discharge_cms

Removals

none

Testing

Tested on Windows GFE for 3 different sets of ras2fim models from the Iowa Flood Center. The ras2rem script runs without error, and the inundation process works without error.

Checklist
You may update this checklist before and/or after creating the PR. If you're unsure about any of them, please ask, we're here to help! These items are what we are going to look for before merging your code.

[ ] Informative and human-readable title, using the format: [_pt] PR: <description>
[ ] If submitting a PR to the dev branch (the default branch), you have a descriptive Feature Branch name using the format: dev-<description-of-change> (e.g.: dev-revise-levee-masking)
[ ] Changes are limited to a single goal (no scope creep)
[ ] The feature branch you're submitting as a PR is up to date (merged) with the latest dev branch
[ ] Any change in functionality is tested
[ ] New functions are documented (with a description, list of inputs, and expected output)
[ ] Project documentation has been updated (CHANGELOG and/or README)
[ ] Reviewers requested

Also satisfies issue #38 to export catchment boundaries as polygons, since it's a necessary input to the inundation script

@LauraKeys-NOAA Please merge with dev and update Changelog with PR (42) number instead of original Issue number (29). Version number can be 1.3.0.

@LauraKeys-NOAA your points for the PR should usually be 1 pt. The points are captured by the issue that the PR resolves, in your case #29. Also, please connect #29 to this PR using the "Development" setting option at the upper right of the PR interface.

Sorry, I didn't usually add the points to the PRs in the inundation-mapping
repo, just left that to Rob H. Will change those.
On Wed, May 3, 2023 at 9:52 AM Brad @.***> wrote:

@LauraKeys-NOAA https://github.com/LauraKeys-NOAA your points for the
PR should usually be 1 pt. The points are captured by the issue that the PR
resolves, in your case #29 https://github.com/NOAA-OWP/ras2fim/issues/29.
Also, please connect #29 https://github.com/NOAA-OWP/ras2fim/issues/29
to this PR using the "Development" setting option at the upper right of the
PR interface.
—
Reply to this email directly, view it on GitHub
https://github.com/NOAA-OWP/ras2fim/pull/42#issuecomment-1533174834, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AQYGADBMX6U2F3KUAGKHMELXEJWI5ANCNFSM6AAAAAAXR7LRDY
.
You are receiving this because you were mentioned.Message ID:
@.***>


Fix worker image name creation on controller

This PR fixes the worker image name creation on the controller.
At this moment the worker image name creation assumes some fixed naming that makes other possible image names fail.
For example, if we use an image like dist.custom.registry.io:5000/brigade/worker:d454e0a8cfd92deaad893a39c2ad5243d97dc7fd the current way will not parse correctly because it doesn't assume that there is a port on the registry, so when it splits by : and takes the second splitted substring, it's not taking the real tag.
Appart from that I think there it's not a real or correct way (or at least I can't imagine one) to split registry and name. Examples:

azure/brigade-worker:1234
myregisitry.com/azure/brigade-worker:1234
myregistry/brigade-worker:1234

I could not say in the first and the last one what is a registry and what is an organization.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: slok sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


Active Storage service?

Hey, love the rationale behind the gem! I'm trying it out for some hobby projects and liking it so far.
And something I've always wondered is: why not use SQLite for blob storage? Raw performance looks pretty good
Is this on the roadmap? I'd love to help

Thanks a lot for the praise!, at the moment I am trying to make sure this is hardened enough for production use.
Now looking at active storage, I have considered it, but haven't yet done any benchmarking to understand the potential limitations, specially with large file sizes. The current state of Ruby sqlite3 drivers are not well suited for that because of the extra memory copying they required during parameter binding.
That said, there is potential here for a very interesting implementation that seamlessly supports file streaming using the sqlite3 incremental blob IO interface, combined with Rack 3 compliant servers.
I will do some testing to check the potential insert/update limitations and report progress here.

Took me ages to get to this, but my testing showed the filesystem to run circles around SQLite when inserting larger files, as we get to 10s and 100s of megabytes the filesystem (ZFS in my case) becomes order(s) of magnitude faster. I can see an opportunity for SQLite acting as a metadata store, but so far, if you are running everything on a single machine, then I would think the ActiveStorage filesystem driver fits the bill.


fix: move spread with root path

Resolves: https://github.com/truflation/truflation/issues/65

if self.path_root:
            spread.move(self.path_root, create=True)

@williamrusdyputra Please sync your PR with main

@georgeciubotaru this fix will include the timestamp fix aswell


TST: install dependencies with Conda on py3.6 tests.

Cover dependency installation via Conda in one of the CI tests.
Addresses https://github.com/pydata/pandas-gbq/pull/39#issuecomment-309157665

Note: Right now I'm getting a failure at https://travis-ci.org/tswast/pandas-gbq/jobs/245990533
$ if [ -f "$REQ.pip" ]; then pip install -r "$REQ.pip"; else conda install --file "$REQ.conda"; fi
Fetching package metadata ...........
PackageNotFoundError: Package missing in current linux-64 channels:
  - google-auth
Close matches found; did you mean one of these?
    google-auth: google-apputils

I see the package at https://conda-forge.github.io/feedstocks, so I'm not sure what's going on.

Ah, per https://conda-forge.github.io/ I think I need to add conda config --add channels conda-forge

Codecov Report

Merging #62 into master will decrease coverage by 45.19%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master      #62      +/-   ##
==========================================
- Coverage   73.44%   28.24%   -45.2%
==========================================
  Files           4        4
  Lines        1540     1540
==========================================
- Hits         1131      435     -696
- Misses        409     1105     +696

Impacted Files
Coverage Δ

pandas_gbq/gbq.py
19.35% <0%> (-55.98%)
:arrow_down:

pandas_gbq/tests/test_gbq.py
27.94% <0%> (-54.94%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 852b2a3...3ab883f. Read the comment docs.

Looks like it is working now that I added the conda-forge channel. https://travis-ci.org/tswast/pandas-gbq/builds/245993672

Hmmm... flake8 is failing now. I don't see how that could be related to this change. Maybe there was a change with flake8 versions.

I updated the Travis config to run lint in the non-conda version. Not sure what is going on, since flake8 runs fine in my local conda environment.

@jreback Is this what you had in mind?

Ping.

@jreback Here is a successful test run from tswast:conda :
https://travis-ci.org/tswast/pandas-gbq/builds/246001341

lgtm
also just review any references in install docs, readme, and pandas docs
if anything needs updating (separate pr)


ATS 9.0.1: current_server_connections, current_server_transactions metrics broken

Feels similar to https://github.com/apache/trafficserver/issues/7163 and https://github.com/apache/trafficserver/issues/7054
Fix for #7054 was #7056.
Fix for #7163 was #7258
Both of these metrics function like a counter, instead of a guage:
proxy.process.http.current_server_connections
proxy.process.http.current_server_transactions

This affects both:
proxy.process.http.current_parent_proxy_connections
proxy.process.http.current_server_connections
Behaviour is constantly additive. Do not see decrements.

proxy.process.http.current_server_connections is a derivative metric too, which derives from
  {"proxy.process.current_server_connections",
   RECD_INT,
   {"proxy.process.http.current_server_connections", "proxy.process.http.current_parent_proxy_connections"}}};

I believe this issue also gives a 'false positive' for proxy.config.http.per_server.connection.max.
Trying to confirm this now...

Interesting, in our 9.0.x build both look ok.  From a server running at low time.
proxy.process.http.current_server_transactions 179
proxy.process.http.current_server_connections 526

Hmm.  Interestingly enough current_server_transactions is broken on my H2 to origin build.

One difference in our environments is that you use parent proxy.  Does you proxy.process.http.current_parent_proxy_connections setting look ok?

This affects both:
proxy.process.http.current_parent_proxy_connections
proxy.process.http.current_server_connections
Behaviour is constantly additive. Do not see decrements.

It doesn't seem a like stat issue. According to memory usage dump (SIGUSR1), Http1ServerSession is leaking.

This is just a possibility, but I thought it's worth noting.
Seems like removal of sessions from the pool depends on inactivity timeout of sessions (or underlying netvcs). If the timeout didn't happen on a session, the session would stay in the pool forever, unless other controls (e.g. per_server.connection.max) kick in.
This line below is suspecious, because it relies on the inactive timeout value currently set. If  inactivity timeout is cancelled or set to 0, it does nothing. I think we need to read the original value from the config.
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/proxy/http/HttpSessionManager.cc#L215
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/iocore/net/P_UnixNetVConnection.h#L348-L352
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/iocore/net/UnixNetVConnection.cc#L1354-L1360
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/iocore/net/P_UnixNetVConnection.h#L362-L368

This is just a possibility, but I thought it's worth noting.
Seems like removal of sessions from the pool depends on inactivity timeout of sessions (or underlying netvcs). If the timeout didn't happen on a session, the session would stay in the pool forever, unless other controls (e.g. per_server.connection.max) kick in.
This line below is suspecious, because it relies on the inactive timeout value currently set. If inactivity timeout is cancelled or set to 0, it does nothing. I think we need to read the original value from the config.

isn't that a configuration bug? Why would you set inactive timeout to zero?

https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/proxy/http/HttpSessionManager.cc#L215
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/iocore/net/P_UnixNetVConnection.h#L348-L352
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/iocore/net/UnixNetVConnection.cc#L1354-L1360
https://github.com/apache/trafficserver/blob/d4fc16f64d3104d3682d496e47f2a53511fa77e0/iocore/net/P_UnixNetVConnection.h#L362-L368

isn't that a configuration bug? Why would you set inactive timeout to zero?

There is a couple of lines set it to 0. And as you can see cancel_inactivity_timeout() set it to 0 too.
$ git grep "set_inactivity_timeout(0)"
iocore/net/QUICNetVConnection.cc:    set_inactivity_timeout(0);
iocore/net/QUICNetVConnection.cc:  this->set_inactivity_timeout(0);
iocore/net/QUICNetVConnection.cc:  this->set_inactivity_timeout(0);
iocore/net/UnixNetVConnection.cc:    set_inactivity_timeout(0);
iocore/net/UnixNetVConnection.cc:  set_inactivity_timeout(0);
proxy/PluginVC.cc:  set_inactivity_timeout(0);
proxy/http2/Http2Stream.cc:  set_inactivity_timeout(0);

But I'm not disagreeing that the issue is caused by misconfiguration. There might be something  that saves the infinite inactivity timeout case.

I think https://github.com/apache/trafficserver/commit/fb6ca11c81325dc2fbf50a525cb1be008ccda33d has a bug. Making keep_alive_no_activity_timeout_out overridable is fine, but using  overridden values after detaching a session from a transaction doesn't make much sense. That behavior means "I want to keep this session in the pool for a shorter/longer time than the default after using it for this transaction".
https://issues.apache.org/jira/browse/TS-863

#7618 didn't work for this.
I checked the number of sessions in session pool by using #7627, and the number seemed reasonable. It didn't keep going up at minimum. So the leak probably happens outside of the pool and there should be a case that doesn't release (or close) server sessions.

Just making a note that 9.1.x is not showing problems with the current_* metrics in our production environment.  But we didn't notice problems with 9.0.1 either.  We aren't using the parent selection logic through.

Do you notice that file descriptors are not being closed as well as server sessions being leaked?

The clearing of the server_session in HttpSM::kill_this is concerning.  As discussed in the "Cleaning up" session of my notes on the H2 to origin PR notes, there are multiple references to the server_session in the tunnel, server_entry, and in the server_session member variable.  With the H2 to origin keeping track of all of that was made even worse by the possibility of two origin classes.  Any kind of characterization of the leaking transaction scenario would be useful.  It is quite likely that we are leaking too, but given our transaction distribution not at such a high rate.
https://docs.google.com/document/d/1sK6AyR-1K795NHsJqpRp4pjZRJ7T5KM78uJlRFMpKiI/edit?usp=sharing
I'll think some more if we can backport a more systematic means of ensuring the server_session has been freed by the time we get to HttpSM::kill_this.  Just calling do_io_close against the server_session object in HttpSM::kill_this is unlikely to work since there are many cases where the HttpServerSession object has already been freed (via the tunnel or the server_entry).

I've been running 9.0.1 for about 24 hours and seeing this as well. The internal connection count seems to just tick up and up, but the connections don't seem to exist. Running traffic_ctl over and over, I do see it go down at times but the overall trend is to grow and grow.
15867 is the pid of traffic_server
lsof -n -p 15867 | wc -l
106540
traffic_ctl metric get proxy.process.net.connections_currently_open
proxy.process.net.connections_currently_open 108760
traffic_ctl metric get proxy.process.http.current_server_connections
proxy.process.http.current_server_connections 160043
traffic_ctl metric get proxy.process.current_server_connections
proxy.process.current_server_connections 159993
We don't use parents so this is normal...
traffic_ctl metric get proxy.process.http.current_parent_proxy_connections
proxy.process.http.current_parent_proxy_connections 0
netstat -ant | wc -l
25203
netstat -antp | grep 15867 | wc -l
8640
So somehow ATS thinks it has 4x the number of connections that the kernel thinks the entire box has and 12x the # of connections that the kernel thinks ATS has.
I'm also seeing a ton more CLOSE_WAITs compared to 8.1.1:
netstat -ant | grep CLOSE | wc -l
4462
On the other boxes in the same 3-node cluster (servicing the same VIPs and same backend origin sites, so extremely similar workload):
netstat -ant | grep CLOSE_WAIT | wc -l
39
netstat -ant | grep CLOSE_WAIT | wc -l
148
All my testing looked good (the throughput is in-line with the other 2 nodes in the cluster; sites load ok; etc), and I wouldn't have even noticed this except that we bumped into the connection limit:
[May 13 10:01:50.185] [ACCEPT 0:8080] WARNING: too many connections, throttling.  connection_type=ACCEPT, current_connections=262149, net_connections_throttle=262144
[May 13 10:11:50.188] [ACCEPT 0:8443] WARNING: too many connections, throttling.  connection_type=ACCEPT, current_connections=262169, net_connections_throttle=262144
[May 13 10:21:50.197] [ACCEPT 0:8443] WARNING: too many connections, throttling.  connection_type=ACCEPT, current_connections=262263, net_connections_throttle=262144
[May 13 10:31:50.198] [ACCEPT 0:8443] WARNING: too many connections, throttling.  connection_type=ACCEPT, current_connections=262208, net_connections_throttle=262144
[May 13 10:41:50.199] [ACCEPT 0:8080] WARNING: too many connections, throttling.  connection_type=ACCEPT, current_connections=262147, net_connections_throttle=262144
I raised proxy.config.net.connections_throttle but the current count seems to creep up and up. I was scouring the upgrade docs to see if I missed something (which could still be the case) and came upon this ticket, so I figured I'd add some info.
No idea if it's related to this but in 9.0.1, I also see a steady of things like:
20210513.20h26m36s BODY_FACTORY: suppressing 'connect#failed_connect' response for url 'X@'
and
20210513.20h26m41s BODY_FACTORY: suppressing 'connect#failed_connect' response for url ''
My 8.1.1 nodes (same VIP, same workload, same backend origin sites) don't have a single equivalent log entry. They of course have entries for other URLs, but always for valid-ish looking URLs, never '' nor 'X@'. I've yet to find a corresponding log entry for the nginx instance that's fronting ATS. Again, I just mention this in the off chance that it's related to the above connection count issue.

@moseleymark what is your traffic like?  Our traffic is a mix of pure proxy and smaller cached objects, and we're not seeing the problem.  If it is not parent selection based, then presumably it is due to differences in traffic patterns.

This is all web hosting traffic, so it's got pretty random traffic patterns. All of my ATS nodes are doing reverse proxy to various parts of 2 /24s (on the same network). We control all the origin selection (all Lua talking to our own DNS), but the actual content could be anything from tiny files to large media files, could be static or dynamic. There are no parents at all, just each trafficserver box talking to origins.
I've been ramping up traffic to our 8.1.1 nodes but I'm starting to see a crash few every days with 8.1.1 ("Fatal: HttpSM.cc:2533: failed assertion magic == HTTP_SM_MAGIC_ALIVE, similar to https://github.com/apache/trafficserver/issues/4921), so I was trying out 9.0.1. The traffic serving part looked great. It's just the connection leak that's an issue.

I reverted #7237 and #7336 then the stats got steady. I think the cause is #7237 but I had to revert #7336 as well because it's an additional fix for #7237 (there's dependency).

Interesting.  I'll work with #7237.
I just noticed on a machine running 9.1.x a little bit of a server session leak.  It had been running for 8 hours.  Took it out of rotation, and still the proxy.process.http.current_server_connections is around 1000 even though according to the OS only about 30 connections are open to the origin.

We are running with a couple differences on our internal 9.0.x branch from what is on ASF.  With 9.1.x we reset against the ASF branch, so that could be we are starting to see a slow leak.
I am working through differences in HttpTunnel.  Just brining over our 9.0 version into our 9.1 build seems to have plugged the leak, but also I may not have waited long enough.
One HttpTunnel difference is that our 9.0 included PR #7386 which did not land in ASF.
There was also a slight difference between what we started with in #7237 and what landed in ASF which remained in our build.
Will continue to try different variations and see how the builds work out.

I think PR #7386 is the difference.  I added that to our 9.1.x build.  Without that change, we leaked around 6000 origin sessions over the period of a day.  With the change, I ran it for an hour or so, then took it out of rotation.  The output of the following commands matched each other nicely as the system drained.
sudo lsof -iTCP -n -P | grep MAIN | grep -v LISTEN | grep -v ":443->" | grep -v ":80->" | wc -l
traffic_ctl metric match http.current.server_connections

I will reopen PR #7386.

I removed the changes in from PR #7386 from our 9.0.x build, and now that test build is showing some origin session leaking.

I've been running a test build with the change from #7386 for an hour, and I don't see the leak.

[approve ci autest]


Potential memory leak in version 41

I am just being greeted by the LeakCanary UI after launching the application from the quick settings tile:

2024-05-02_17-15-55_953.hprof.gz

Are you running a debug build? Leak canary is not enabled in production
The Android OS has a memory leak in the TileService, there is nothing we can do about it sadly.

Are you running a debug build? Leak canary is not enabled in production

Yes, for testing #280.

The Android OS has a memory leak in the TileService, there is nothing we can do about it sadly.

Thanks for the info, in that case I'm closing this, then.


Various errors when deploying CloudNativeFullStack

When utilizing the CloudNativeFullStack, we are getting the following errors when Dynatrace auto-injection occurs
Context
At the moment, the CloudNativeFullstack configuration we have pulls the OneAgent image from an AWS-based Activegate within our tenant, and reaches out to SaaS to register clusters (screenshot for a rough idea)

Sample K8s cloudnativefullstack yaml we have atm
apiVersion: dynatrace.com/v1beta1
kind: DynaKube
metadata:
  # Dynatrace takes the name of the cluster as the name of the kubernetes integration in portal - issue put in git to fix
  name: myclustername
  namespace: dynatrace
  annotations:
    alpha.operator.dynatrace.com/feature-automatic-kubernetes-api-monitoring: "true"

spec:
  apiUrl: https://mydynatraceactivegate:9999/e/<upstream_saas_tenant>/api
  #
  tokens: dynakube

  trustedCAs: trustedcert

  networkZone: <saas networkzone>

  namespaceSelector:
    matchLabels:
      <namespace>: <ignore this>

  oneAgent:
    # Enable cloud-native fullstack monitoring and change its settings
    # Cannot be used in conjunction with classic fullstack monitoring, application-only monitoring or host monitoring
    cloudNativeFullStack:
      tolerations:
        - effect: NoSchedule
          key: node-role.kubernetes.io/master
          operator: Exists

  # Configuration for ActiveGate instances.
  activeGate:
    # Enables listed ActiveGate capabilities
    capabilities:
      - routing
      - kubernetes-monitoring
      - metrics-ingest

    group: <activegate group, ignore :)>
    customProperties:
      value: |
        [http.client]
        # Set to Services Proxy
        proxy-server=<internal proxy server>.com
        proxy-port=3128
        proxy-non-proxy-hosts = <BIG list of noproxy ips for aws and internal stuff>

Error 1, K8sNodeName issues
Within the install-oneagent initContainer, for some reason there are cases where the node name isn't found, so the install-oneagent container completely breaks clusters in EKS sometimes - I presume its due to the oneagent installer not accounting for cases where the K8s api does a backoff when attempting to fetch the node name (see https://github.com/kubernetes/kubernetes/issues/54482 for what I mean, there should be backup 'node name' which is equivalent to the ip spec if not found)
/mnt/config/init.sh: line 35: im_nodes[${K8S_NODE_NAME}]: unbound variable

I think this is due to Pod Mutation code here (https://github.com/Dynatrace/dynatrace-operator/blob/ae549a3c08b1fa3a6883f5cf14e9451356be0c38/src/webhook/mutation/pod_mutator.go#L361) not properly allocating for nodeName being different
Error 2,
At other times, for some reason, we're getting this error from the install-oneagent container
/mnt/config/init.sh: line 29: [""]="xxx": bad array subscript

xxx above is the dynatrace environment name for our SaaS tenant

Thanks for reporting this.
We are investigating on our end.

@Forcebyte the issue you linked only mentions that you can't rename the nodes on cloud clusters, but I didn't see anything about a back-off.
The following error is somewhat ok (if it fixes it self after 1-2 minutes), it has to do with a race condition we have that can't really be resolved, so we fail/restart until it gets resolved.
/mnt/config/init.sh: line 35: im_nodes[${K8S_NODE_NAME}]: unbound variable

And the following would only happen if one of the nodes in your cluster has no name (which doesn't sound possible)
/mnt/config/init.sh: line 29: [""]="xxx": bad array subscript

Did I miss something ?

I will close this ticket since it seems to have been answered. If you feel like your question was not properly addressed, please feel free to reopen it.


SQLite Migrate Exception: AUTOINCREMENT is only allowed on an INTEGER PRIMARY KEY

What steps will reproduce the problem?

Use 'dsn' => 'sqlite:' . __DIR__ . '/../runtime/database.sqlite', in config/db.php on yii2-app-basic.

Create a migration as:

use yii\db\Migration;
class m160509_093358_foobar extends Migration
{
public function up()
{
$this->createTable('foobar', [
'id' => $this->bigPrimaryKey(),
]);
}
public function down()
{
    $this->dropTable('foobar');
}

}

3. Run ./yii migrate

### What is the expected result?

*** applying m160509_093358_foobar
> create table foobar ...Exception 'yii\db\Exception' with message 'SQLSTATE[HY000]: General error: 1 AUTOINCREMENT is only allowed on an INTEGER PRIMARY KEY
Failed to prepare SQL: CREATE TABLE foobar (
id bigint PRIMARY KEY AUTOINCREMENT NOT NULL
)'
in C:\Users\larry\foobar\vendor\yiisoft\yii2\db\Command.php:230
Error Info:
Array
(
[0] => HY000
[1] => 1
[2] => AUTOINCREMENT is only allowed on an INTEGER PRIMARY KEY
)

### What do you get instead?

Revert af75262541e83f353a36baf888b3392c9d34f201 changes

### Additional info

| Q                | A
| ---------------- | ---
| Yii version      | 2.0.8
| PHP version      | 7.0.6
| Operating system | Windows 10

@larryli how would you solve this issue?

@samdark Revert af75262

need to add a comment that this is intentionally the same as normal integer. also need a test that breaks in case someone will change it,

@cebe Doesn't it make more sense to throw an exception?
If I make a migration I specify big integer for a reason; I wouldn't be too happy if you silently went ahead and created a normal integer. That could cause me to get into trouble later when I use the application.
I think failing early is better; if needed the implementor could then fallback to normal int primary key by catching the exception.

If I make a migration I specify big integer for a reason; I wouldn't be too happy if you silently went ahead and created a normal integer. That could cause me to get into trouble later when I use the application.

What kind of trouble? SQLite INTEGER can store signed 8-bytes integer, same as MySQL BIGINT.

Ah, my bad. I thought it was about implicitly using another type that has a smaller domain. :8ball:

My suggestion:

Mysqlite doesnt allow autoincrements on BIGINT, so the 'autoincrement' should be removed out of the statement.
Force bigPrimarykey to be an INT so that people using Mysqlite for testing wont have issues on autoincrements. For those using Mysqlite in production and need BIG INT, let them specify this requirement themselves (as the usecase is much more rare )

https://github.com/yiisoft/yii2/pull/11653


window walker has hardcoded text

saw this in dllmain.cpp
MODULE_NAME and MODULE_DESC is what i saw, may be others.
// The PowerToy name that will be shown in the settings.
const static wchar_t* MODULE_NAME = L"Window Walker";

Note: I'm currently doing text tweaks and did touch the MODULE_DESC

This also brings up the issue that window Walker internally also has help text that is hardcoded as well.

Should we just make this “localize ready window walker?”

The fix is now available in 0.16 https://github.com/microsoft/PowerToys/releases


avira prime can't uninstall

Dear BCU
I could not uninstall Avira prime 90 day free trail. I knocked out my windscribe VPN and rendered brave inoperable with windscribe, and even by itself, even after disabling brave site by site in search. BCU unistalls it but it still remains. a new utility pops up in uninstal avira.spotlight. ... But I can't kill it or all of them.

Try uninstalling it in safe mode. There should also be an official Avira uninstall utility on their website.

Dear Mr Marcin
dell reset my windows and that should have fixed it.
thank you.
cando
On 20-10-2023 09:34 AM, Marcin Szeniak wrote:

Try uninstalling it in safe mode. There should also be an official
Avira uninstall utility on their website. --Reply to this email
directly, view it on GitHub, or unsubscribe.You are receiving this bec
DuckDuckGo removed one tracker. More [1]
Report Spam [2]
Try uninstalling it in safe mode. There should also be an official
Avira uninstall utility on their website.
--
Reply to this email directly, view it on GitHub [3], or unsubscribe
[4].
You are receiving this because you authored the thread.Message ID:
@.***>

--
NULL
Links:
[1]
https://duckduckgo.com/-omA2L5Il_qGIJI5lS2OdvymOOngH8EJQi3ZtHp6nvp3LQzbCnA5vlp5UFJnz3n_2aiYWQ9T2WsbQH1rY1FmO3n824LHdipznEAXiY8E-eyttNPIyOxnriEY87rX-_-LThq2sZTD4nn-eteBTBgkgpEUh0S16MMV8JmQ0C0igP39Y4girBxb9eMLpkC-ZU5cIBU5h4frQqVao2YP1eaYGlosEs0Tz5g_dF-sgnMdmsZQ2xP57s8ry8fsDAHs4bdk_E4OmXJ4KKxTnZj6z2yUtNeeygllE-pQDmR4NHhSiyy3cANbvP2pBRGDxJbCoVUsR_EEwM3Eu93eHNOnARd6gDGE7GEl39WfYN_cxPROErlQM5nqvSI7lXY7gf_65zQhLvkEj_k9ldHCK5LKnYPrnGAu1tEWWe9-6ZVjo3VdBPoFlBSW_n9x9EGGat1rZU2Sa0gPsPU13NBgKlcu4s-kioNBUH9WgNFA7TaoHoz4k5ObvKTAbZhWAU
[2]
https://duckduckgo.com/-omA2L5Il_qGIJI5lS2OdvymOOngH8EJQi3ZtHp6nvp3LQzbCnA5vlp5UFJnz3n_2aiYWQ9T2WsbQH1rY1FmO3n824LHdipznEAXiY8E-eyttNPIyOxnriEY87rX-_-LThq2sZTD4nn-eteBTBgkgpEUh0S16MMV8JmQ0C0igP39Y4girBxb9eMLpkC-ZU5cIBU5h4frQqVao2YP1eaYGlosEs0Tz5g_dF-sgnMdmsZQ2xP57s8ry8fsDAHs4bdk_E4OmXJ4KKxTnZj6z2yUtNeeygllE-pQDmR4NHhSiyy3cANbvP2pBRGDxJbCoVUsR_EEwM3Eu93eHNOnARd6gDGE7GEl39WfYN_cxPROErlQM5nqvSI7lXY7gf_65zQhLvkEj_k9ldHCK5LKnYPrnGAu1tEWWe9-6ZVjo3VdBPoFlBSW_n9x9EGGat1rZU2Sa0gPsPU13NBgKlcu4s-kioNBUH9WgNFA7TaoHoz4k5ObvKTAbZhWAU
[3]
https://github.com/Klocman/Bulk-Crap-Uninstaller/issues/545#issuecomment-1771841344
[4]
https://github.com/notifications/unsubscribe-auth/AHAN2CMCE5NKXVZMMC6QYE3YAG2JVAVCNFSM6AAAAAA573YA3GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONZRHA2DCMZUGQ


offset days of the week

When the two choices of dates on the same page there is a shift weekdays.
We must declare so:
var weekDaysList = ["Sat", "Sun", "Mon", "Tue", "Wed", "Thu", "Fri"];
instead:
var weekDaysList = ["Sun", "Mon", "Tue", "Wed", "Thu", "Fri", "Sat"];
Let the bonus question on iOS but to click on the outside as much as possible and close the month_dropdown year_dropdown? Buttons not any there, a little inconvenient.

I have tested in both android and iPhone. It's working fine. Could you please check the demo i mentioned in the repository.


Archive in favor of vscode-remote?

vscode-remote was recently released :confetti_ball:
Some quick differences:

code-server is entirely open-source. vscode-remote is not for now.
code-server provides access via a web-browser. vscode has this in the works ATM.

Does anyone extract value from code-server that vscode-remote doesn't provide? If not, it'd be great to archive.

From what I understand, the vscode-remote is essentially vscode with remote file system mounting. The binary is still running on a local machine. For resource-limited devices code-server would still be the preferred choice until such a time that vscode-remote allows web-browser porting/access.

I tried to open super large project with both solution (code-server & MS Remote Development) on my macbook. TBH, code-server is way more faster than the extension.

https://code.visualstudio.com/docs/remote/faq#_why-arent-the-remote-development-extensions-or-their-components-open-source
To me it seems like they don't want to open source it at all

Self-hosted online VSCode.  VSCode Remote and the future VSCode Online don't seem to offer that.  Self-hosting is required in an enterprise setting.

The binary is still running on a local machine.

The vscode binary: yes. The application binary, however, runs on the remote machine. I don't think this is an issue for resource-limited devices.

I think its important for users without access to OS that can support VSCode binary, strange as it may seem I find myself often with a Chromebook only and travelling and I highly value the option this projects gives me which is NOT what vscode-remote provides at all!

While I do see that the introduction of this service may put the current business model behind code-server at jeopardy I also want to express that I value the possibility to use this editor without the being dependent on Microsoft or its infrastructure.
If you decide to stop development maybe https://github.com/theia-ide could be an alternative (although at this point in time it does not offer the same "one binary" convenience as code-server does).

We still have a market for this thing. The only problem that I encounter that people might also encounter is the memory usage spike on a active session. This should have been fixed at some point in time, but it seems to be buried in backlog for now. Until it matches Theia's memory usage (~150MB), its almost impossible to use Code-server for Kubernetes hosts that has stricter memory requirements.

code-server has its unique application scenario, neither vscode-remote nor visual studio online can replace the status of code-server perfectly.

I use a Chromebook for 99% of my work now.  1% is done via a RDP session via my Chromebook.   Eclipse Che is way to complicated and heavyweight.  It is trying to adopt a more modern approach but is painful to use outside of Java.  Cloud9 seems to have died on the vine, and theia is more of a toolkit than a usable product.  VS Code is one of the best dev envs to come along in a while as it is not just good at once language.  Yes, Javascript is the most popular, but its actually enjoyable to use with python and even strange formats like ReST.  I understand that what the coder guys are doing is NOT trivial and I hope there is a way they can monetize it and still be open source.  Open source dev tools are hard, the audience can go from using it because they can't (or don't want to) afford a paid solution, or they genuinely do want to be part of an open ecosystem. Ask Trolltech/Nokia/Digia/QtCompany how easy that is :P   Either way, I think this project is nice.  I just hope we can all come to an agreeable arrangement here so they can pay the rent, and we can enjoy coding on our Chromebooks!

@geiseri if this also consoles you, try hosting code-server on your Crostini instance as well.

I can assure you, with Microsoft's stance on hosted platforms, our project will stay @geiseri. We won't go anywhere.

Code-server has been one of my favorite projects since its release. I love managing my setup on my own server. I do use a Chromebook over my Macs when I can and plan to continue to do so. So far, this project has played a huge part in that, and I for one expect to see this project thrive

How about both? have code-server to run on the browsers and connecting  to vscode-remote

its up to you if you really want to use both, however, in our side, this seems redundant for the VSO one, but the vscode remote tools would definitely allow more interopability.

Yeah, I think that most of the "workspace" extensions are available and you can install them on vscode-remote. Is code-server have its own marketplace? If so this could open to having more extensions consumed by code-server because they're on vscode-server.

They work in a different way.
The users don't have to install anything when accessing the code-server.
If portable or flexible matters in such scenario, code-server is the only choice.

code-server development will be continuing. :confetti_ball:


This directive makes v-show not work when been added after it

After adding v-model to something with v-show directive, v-show seems to be not work.
v-show works
<div
  v-model={ this.updateGroupForm.show }
  v-show={ showSetting }

v-show does not work
<div
  v-show={ showSetting }
  v-model={ this.updateGroupForm.show }

I have the same issue.


GCP: Backend

Backend includes two set of resources
Backend Buckets : https://cloud.google.com/compute/docs/reference/rest/v1/backendBuckets
Backend Services : https://cloud.google.com/compute/docs/reference/rest/v1/backendServices
(region) : https://cloud.google.com/compute/docs/reference/rest/v1/regionBackendServices

The PR needs to have some conflicts fixed.


Nginx reverse proxy filters DAVx⁵ Android app

Hi,
I could not access anymore to my contacts and calendars from my phone since I migrated from Apache2 reverse proxy on my NAS to opnsense and Nginx.
I ended up finding DAVx⁵ uses a user-agent which triggers bot protection in opnsense implemetation of Nginx :
DAVx5/3.3.7-ose (2020/11/30; dav4jvm; okhttp/4.9.0) Android/10\r\n
okhttp is one of the string matching line 220 of http.conf file.
The workaround is obviously the disable bot protection option and it is ok for me until I want to access my Nextcloud instance from outside my network.
I can think of an if/else dirty fix and may propose a Pull request for it but if anyone has a nicer solution, it may be better.
I also published the issue on DAVx⁵ forum.

opnsense version: 20.7.7
nginx plugin version: 1.19
To replicate the issue you have to install DAVx⁵ on an android phone or emulator and try to access a nginx protected server with bot protection activated. The request should be immediately blocked by nginx. No request reaches the web server and the phone appears after a few minutes in the nginx ban list.

opnsense version: 20.7.7
nginx plugin version: 1.19
To replicate the issue you have to install DAVx⁵ on an android phone or emulator and try to access a nginx protected server with bot protection activated. The request should be immediately blocked by nginx. No request reaches the web server and the phone appears after a few minutes in the nginx ban list.

A nicer way to fix this and allow anyone to sort it out would be to allow users to whitelist some user-agents but I am not able to develop this.

A nicer way to fix this and allow anyone to sort it out would be to allow users to whitelist some user-agents but I am not able to develop this.

@molusk
you can try to disable bot protection and add custom "if ($http_user_agent...return" via server _pre hook
https://github.com/opnsense/plugins/blob/b2d5d685e32968604feea055b8d6285211d4d0e1/www/nginx/src/opnsense/service/templates/OPNsense/Nginx/http.conf#L281

@molusk
you can try to disable bot protection and add custom "if ($http_user_agent...return" via server _pre hook
https://github.com/opnsense/plugins/blob/b2d5d685e32968604feea055b8d6285211d4d0e1/www/nginx/src/opnsense/service/templates/OPNsense/Nginx/http.conf#L281

The issue seems still existing as of today.

The workaround is obviously the disable bot protection option and it is ok for me until I want to access my Nextcloud instance from outside my network.

Disabling the bot protection for the http server seems strangely not to work for me.

you can try to disable bot protection and add custom "if ($http_user_agent...return" via server _pre hook
@kulikov-a Would I be able to whitelist the UA with the _pre hook? And could you please elaborate a little on how this would look like or point me to some documentation. Thx!

@sjjh Hi

Would I be able to whitelist the UA with the _pre hook?

Disabling bot protection in the GUI should definitely have worked if that was the cause.
Bot UA can be edited in the GUI since version 1.33.
Hooks usage in general described at  https://forum.opnsense.org/index.php?topic=21154.msg99523#msg99523
but..I mentioned using a hook with the idea of creating a custom UA set when disabling bot protection (and before 1.33). If you only need to disable bot protection - disabling it in UI should definitely be enough

Thx for the quick feedback! Disabling bot protection and restarting nginx via the GUI somehow did not work for me. As a dirty hot fix, for now I have removed the UA from the list in the configuration file via the shell. As an update is overdue anyway, I assume that I can solve it permanently by editing the bot UA in the GUI after the update to 1.33. I'll report back, if I'm having further trouble.


Add support for records nested within implicit template specializations

Right now records nested within template specializations are not properly translated. The currently handling is broken in different ways depending on whether the template was late-instantiated.
template<typename T> class MyTemplate
{
public:
    T Field1;
    T Field2;

    T Method(T x)
    {
        return x;
    }

    struct MyStruct
    {
        T NestedField;
    };
};

typedef MyTemplate<int> MyTemplateInt;
typedef MyTemplate<short> MyTemplateShort;

int Test(MyTemplate<int>::MyStruct& s)
{
    return s.NestedField;
}

MyTemplate<int>::MyStruct will be missing from the translation. The MyStruct which is enumerated when translating MyTemplate<int> has a definition, but the enumerated cursor is not considered to be the actual definition. This causes it to be skipped by this logic in TranslationUnitParser. (The intent here is that the definition will be encountered later on and we'll translate it then. Since this record is only implicitly defined it will never be countered.)
The ideal fix here would be to see if Clang somehow marks this as a declaration which was created by an implicit template instantiation and in that scenario we just use the definition. (And maybe keep track of a HashSet to assert we aren't double-translating these types somehow*

MyTemplate<short>::MyStruct will be present, but it will be a TranslatedUndefinedRecord since the cursor has no definition. Additionally, the raw child declarations list appears to be empty. It seems like there's an extra level of laziness for types nested within a templated type. The fix for this might be similar to the fix for https://github.com/InfectedLibraries/Biohazrd/issues/153

*Possible test case to verify this bit:
template<typename T> class MyTemplate
{
public:
    struct MyStruct;

    T Method(MyStruct& s)
    {
        return s.NestedField;
    }

    struct MyStruct
    {
        T NestedField;
    };
};

Appended title to clarify that this does not happen with explicit template instantiations. (This is covered by TemplateTests.ExplicitTemplateSpecialization)
The issues outlined in this issue should be covered by TemplateTests.ImplicitTemplateSpecialization_NestedRecord


Add theming support

Alaska Airlines Pull Request
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Resolves: #57
Summary:
Please summarize the scope of the changes you have submitted, what the intent of the work is and anything that describes the before/after state of the project.

Update latest dependencies
Replace colors with tier 3 tokens

Type of change:
Please delete options that are not relevant.

[x] New capability
[x] Revision of an existing capability
[ ] Infrastructure change (automation, etc.)
[ ] Other (please elaborate)

Checklist:

[x] My update follows the CONTRIBUTING guidelines of this project
[x] I have performed a self-review of my own update

By submitting this Pull Request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Pull Requests will be evaluated by their quality of update and whether it is consistent with the goals and values of this project. Any submission is to be considered a conversation between the submitter and the maintainers of this project and may require changes to your submission.
Thank you for your submission!
-- Auro Design System Team

:tada: This PR is included in version 2.2.0-beta.1 :tada:
The release is available on:

npm package (@beta dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


add oathtool for amazon alexa authentication

Is your feature request related to a problem? Please describe.
Can you add the oathtool to the linux for alexa script authentification ?
Describe the solution you'd like
I think you can find the code here....
https://gitlab.com/oath-toolkit/oath-toolkit/tree/master
Describe alternatives you've considered
can not find a binary for this linux image
Additional context
For using this script
https://blog.loetzimmer.de/2017/10/amazon-alexa-hort-auf-die-shell-echo.html

Sorry, but I think this tool (oauthtool) would be better suited in a dedicated/separate CCU-Addon package instead of directly bundling it into RaspberryMatic for everyone since only a minor amount of users would require it constantly. Thus, I would suggest to create a separate "oauthtool CCU Addon" package or ask the author of the hm-tools CCU Addon package (see https://github.com/fhetty/hm-tools) to include oauthtool in a future addon version.


Add optional accessToken parameter

so that signature request can be sent using oAuth flow

Hi @1michfan! Thanks for this contribution, and sorry it's taken us this long to respond. This functionality has been added in the 1.4.0 Release, which should be getting published to NuGet in the next few days.
To use it, simply call UseOAuth2Authentication on a new or existing Client instance:
var client = new Client();
client.UseOAuth2Authentication("OAUTH ACCESS TOKEN HERE");
// ...

Cheers!

@BHSPitMonkey Thank you for your work! I'm ready to try it out, do you have an ETA for the nuget package?

We ran into a hiccup getting the new package hosted on NuGet, but it's being worked on and we'll hopefully have it up later this week. In the meantime, you can download the .nuget package directly from the Release page in case it helps:
https://github.com/hellosign/hellosign-dotnet-sdk/releases/tag/v1.4.0


Unit tests for Utils

Empty tests are there to discuss how or if to test those functions.

Please edit travis/build.sh

I'll look at the stubs tomorrow

@cco3 can you take a quick peek at this again?

LGTM


Arithmetic operations don't work in BETWEEN predicate

When running this query, Presto returns the wrong result:
presto:sf1>
select
		sum(l.extendedprice * l.discount) as revenue
from
		lineitem l
where
		date_parse(l.shipdate, '%Y-%m-%d') >= date '1994-01-01'
		and date_parse(l.shipdate, '%Y-%m-%d') < date '1995-01-01'
		and l.discount between 0.06 - 0.01 and 0.06 + 0.01
		and l.quantity < 24;

       revenue
----------------------
 7.520776818550003E7
(1 row)

However, the actual result should be:
       revenue
----------------------
 1.2314107822829998E8
(1 row)
```

Replacing `l.discount between 0.06 - 0.01 and 0.06 + 0.01` with `l.discount between 0.05 and 0.07` solves the problem.

I am using the tpch catalog and sf1 schema. The query is taken from TPC-H (query 6).

That's because those number use double precision math, rather than exact decimals, therefore the results may not be identical.

https://github.com/facebook/presto/issues/2797


Change test plots

Change test plots from daily to weekly plots and update README. Also change size of legend in data-desc and data-geo plots.

Thanks :)


Firefox - consider enabling Wayland by default

Describe the bug
ref: https://www.phoronix.com/scan.php?page=news_item&px=Firefox-98.0
It sounds like:

other distros are doing it
it's about hesitancy around other bits of the user/gpu-space, where we know we're pretty up-to-date

It might also be overkill, we have firefox-wayland, but I'm also eager to test out the soon-to-be default path asap - I've been waiting for firefox+wayland for way, way too long.

Firefox Wayland currently shows undefined icon on GNOME shell.
This may be a blocking issue.

That is #165107

I'm not exactly sure how this is actionable. They cite that Ubuntu and Fedora carry "the patches", which is big boy words for very small real world changes.

Ubuntu enables MOZ_ENABLE_WAYLAND 1y ago in a wrapper shellscript, just like firefox-wayland does
https://bazaar.launchpad.net/~mozillateam/firefox/firefox.hirsute/revision/1478
Fedora enables MOZ_ENABLE_WAYLAND 4y ago in a wrapper shellscript (firefox-wayland.sh.in) that gets used in firefox-wayland.desktop
https://src.fedoraproject.org/rpms/firefox/c/c45606f4574eb364f78af13cde501c02c2207228?branch=rawhide


Type of empty array should not be unit

We should do type inference here. Failing that, we could just error

Fixed in 5f2f8928b5c6761175d3a353baddd669ddd5293d


brfs breaks source maps

I love brfs, but this issue is right now my number one annoyance.  To replicate this, take any multifile bundle and add an fs.readSync with brfs.  Open up the result in chrome, and you get a single giant blob.
Any ideas on what could be done to fix this situation?

any news on this ? can brfs support source maps ?

I am not sure this issue will ever be solved with the current iteration of static-module – it will take a refactor (which might be worthwhile since that module has gotten pretty hairy) or building on top another source transformer altogether.
I experimented with the latter here:
https://github.com/Jam3/brfs-babel
It supports some (but not all) of brfs use cases, and since it builds on babel some aspects (like removing nodes) are very trivial without worrying about source maps. However, babel does not support async transformations, so it will probably never replace static-module.

https://github.com/browserify/brfs/commit/f8c924a49156139c36d2a510181929028fc75b76
:package: 1.5.0

Update 1.4.4 to 1.5.0 breaks sourcemap for my case:

node 8.9.4
budo 11.2.0 /  browserify 16.1.0

This should be reopened. Still breaks the sourcemaps here too.

In what way? Can you share an example?

Sure:
const fs = require("fs");
const browserify = require("browserify");
browserify("./script.js", { debug: true })
  .transform("babelify", {presets: ["env"], sourceMaps: true})
  .transform("brfs")
  .bundle()
  .pipe(fs.createWriteStream("bundle.js"));

With the .transform("brfs") line, the sourcemap contains the transpiled source instead of the original.

Thanks, moving to https://github.com/browserify/brfs/issues/86!


From dosbox-x : use overlay file when its newer than zips

Hi!
A very discrete problem:
i have a zip of an dos game. This is mounted via dosboxx via physfs overlay.
In this archive there is an file "sndcfg.ini". I need to replace this file while using the overlay. This is not possible. This the old file from the archive is used, although there is the new sndcfg.ini in the overlay part.
wish: in doubt use the overlays file (when its newer etc)
marco

Seconding this request, the ability for the overlay to see newer versions of the file would be a great helps.

If the overlay is mounted earlier in the search path, it should override the .zip file's version (and function as an "overlay" would be expected to). Is this not the case?

With dosbox-x you have to mount the .zip then the overlay otherwise it throws up an error. Any totally new files are ok with changes being reflected as things should. However files that exist inside the zip then subsequently modified are not picked up. Not sure if this is due to a specific implementation of how DosBox-x uses PhyFS or an issue with the library. It's briefly discussed in joncampbell123/dosbox-x#3355

https://github.com/joncampbell123/dosbox-x/blob/3b002fa724a67b3cf26d5030391cbf3d5dea90a0/src/dos/drive_physfs.cpp#L371
Make that 1 a 0 so the overlay gets checked for files before the thing it overlays.

(Closing this under the assumption this isn't a PhysicsFS bug, but if there's more information later, please don't hesitate to mention it and we can reopen the bug.)


fix: page title is not updated after language switch. fixed: #4799

Description
修复页面标题未能随着当前语言切换自动更新
Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] Please, don't make changes to pnpm-lock.yaml unless you introduce a new test example.

Checklist

ℹ Check all checkboxes - this will indicate that you have done everything in accordance with the rules in CONTRIBUTING.

[ ] If you introduce new functionality, document it. You can run documentation with pnpm run docs:dev command.
[ ] Run the tests with pnpm test.
[ ] Changes in changelog are generated from PR name. Please, make sure that it explains your changes in an understandable manner. Please, prefix changeset messages with feat:, fix:, perf:, docs:, or chore:.
[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

Summary by CodeRabbit
Release Notes

New Features

Enhanced dynamic title management based on routing and user preferences across multiple applications.
Improved initialization process to ensure the application title updates reactively as routes change.

Bug Fixes

Removed outdated dynamic title functionality that was causing inconsistencies when navigating between routes.

Chores

Updated import statements for clarity and organization.

These updates aim to improve user experience by providing contextual information in the application title and ensuring a smoother navigation experience.

此PR未能在动态修改系统配置中的动态标题后


problem while running script

when i press it does nothing, just pop up and gone

Check #33

i do not understand. i already do pyhon -m pip install requests and when i did that it just show nothing and i run the script it just pop up and gone

same thing happens to me when i run with python


Add Delete Session Functionality

Re-considered adding this feature. Decided against it. It doesn't really fit into the use-case for this library. If one needs to perform session / plot management, it makes more sense to do it directly on the lightning-viz server.


feat: add lemonade clipboard utility

There are packages for this utility but the current maintainer doesn't seem to make them often, if at all.  I attempted to have this build the most recent lemonade (which isn't very recent, but more recent than the last packages were made).

@williamboman I'm not certain how to satisfy the package tests. I don't want mason to download packages (see above comment for why).

Hello! I fail to see how this is related to Neovim? Seems out of scope for the core registry

lemonade is supported by Neovim as a clipboard tool (see :h clipboard-tool). In some environments, including my own, it's the only viable way to have two-way clipboard sharing between a remote nvim and a local nvim.  So having it installed is required to have Neovim work as expected.

Ah, I see. I still think it's somewhat in a gray area (evident by the empty languages and categories), but I think there's a strong enough use case for it so let's add it :)
The golang source is currently restricted to packages published to https://pkg.go.dev/ (and their underlying versions as provided by the pkg.go.dev API). They do seem to have cut a release in their latest commit 2 years ago (1.1.2) - let's use that instead (I'll update it right away and merge).


Memory Requirement for running MetaApprox on Pubmed

Thanks for your wonderful work in "Graph Structure Learning for Robust Graph Neural Networks", KDD'20.
I am trying to repeat your results on Pubmed, especially the one based on mettack.
However, mettack requires large memory to run on Pubmed, such that it cannot fit into a GPU with 16GB memory.
I have also tried MetaApprox [1], but still facing similar problems.

Could you please share some experience on the memory requirement when you evaluate mettack?

You mentioned A-Meta-Self as the approximate version of meta-self, which saves memory and time. Is A-Meta-Self the same as the MetaApprox?

Thanks,
Boyuan
[1] https://github.com/DSE-MSU/DeepRobust/blob/master/deeprobust/graph/global_attack/mettack.py

Hi BoyuanFeng,
Thank you for your interest in our work!
Both metattack and Pro-GNN directly deal with dense matrix, which indicates they are not scalable for large graphs.

For Pubmed, I used Tesla V100 (with 32 GB GPU memory) for the experiments for our model. But original mettack will still face memory issue so I turned to A-Meta-Self, as suggested in Table 8 of their paper https://openreview.net/pdf?id=Bylnx209YX.
Yes, A-Meta-Self means MetaApprox with self-learning.

Hope this post can help you. Thanks again.

Thanks for the quick update.
I am able to run MetaApprox on Pubmed now with a Tesla V100 (with 32 GB GPU memory). I am kind of surprised that MetaApprox uses 32396 MB out of 32510 MB on the Tesla V100.
In addition, could you please share some experience on, how long MetaApprox runs on Pubmed?
If I use the default setting (train_iter=100) and attack 20% edges for MetaApprox on Pubmed, it would take 2600 hours on Tesla V100...

I kind of forget about the detailed setting and it seems I used train_iters=30. It did not take me more than one day to finish generating 20% edges. So maybe you can try train_iters=30.

Thanks for the information!
I was using the MetaApprox in DeepRobust. I will try the TensorFlow implementation.


autoCreateRelatedRecord

It took me a while of googling and asking around today to figure out how to have mirage auto-create relationships for me. I don't have to use afterCreate, and I don't have to do it manually everywhere.
The association() helper can do it! 🎉
In my head I think of this helper as autoCreateRelationshipIfNeeded() or autoCreateRelatedRecord - I think that's its one purpose.
Would it make sense to alias or rename association to something more specific, or does it do more than this one thing?

I think "if needed" because the auto-creation doesn't happen if we pass in an instance during the create() call - we can overwrite this default value.

I agree the term is a bit vague. It was borrowed from factory_girl (the thoughtbot library).
I wonder if more info in the Factories section of the docs would have helped?

I also didn't know about this "association" feature despite the fact I've carefully read the docs recently. Agree that docs update would be helpful.
I like a declarative nature of the "association" name.

Actually association is well explained in the Factories API section - http://www.ember-cli-mirage.com/docs/v0.4.x/factories/#factories-and-relationships
I think Seeding your database has to be updated to mention assotiation helper.

Going to stick with the name and close this for now, but if anyone has any specific docs updates they'd like to suggest/PR I'm happy to merge!


I keep facing error that breaks the execution of the program everytime I try to prompt is to build something like a password generator

pydantic.v1.error_wrappers.ValidationError: 1 validation error for AIMessage
is_chunk
  unexpected value; permitted: False (type=value_error.const; given=True; permitted=(False,))

 for context . . .  here is the whole traceback

 Traceback (most recent call last):

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/bin/gpt-engineer", line 8, in <module>
    sys.exit(app())
             ^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/gpt_engineer/main.py", line 96, in main
    messages = step(ai, dbs)
               ^^^^^^^^^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/gpt_engineer/steps.py", line 192, in gen_clarified_code
    messages = AI.deserialize_messages(dbs.logs[clarify.__name__])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/gpt_engineer/ai.py", line 216, in deserialize_messages
    return list(messages_from_dict(json.loads(jsondictstr)))  # type: ignore
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/langchain/schema/messages.py", line 351, in messages_from_dict
    return [_message_from_dict(m) for m in messages]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/langchain/schema/messages.py", line 351, in <listcomp>
    return [_message_from_dict(m) for m in messages]
            ^^^^^^^^^^^^^^^^^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/langchain/schema/messages.py", line 331, in _message_from_dict
    return AIMessage(**message["data"])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/langchain/load/serializable.py", line 97, in __init__
    super().__init__(**kwargs)

  File "/home/samuel/.local/share/virtualenvs/test-zF55lqY5/lib/python3.11/site-packages/pydantic/v1/main.py", line 341, in __init__
    raise validation_error

pydantic.v1.error_wrappers.ValidationError: 1 validation error for AIMessage
is_chunk
  unexpected value; permitted: False (type=value_error.const; given=True; permitted=(False,))

Interesting! For reproduction purposes, can you provide:

the gpt-engineer commit that you are running
the which LLM you are running (for example chatGPT4)
the prompt that leads to this problem (at least most of the time).

Thanks for the info!
The version on pypi is quite outdated and will be updated soon. Can you try and pip install the version on the current master branch?
To do this, pip uninstall gpt-engineer, then clone the repo, navigate to the repo with a terminal and type pip install . .

Thank you very much. This worked


fix(@angular/cli): fix failing generate duplicate component e2e test

Closed via https://github.com/angular/angular-cli/commit/5663a577d4a72c03a425de19ff53ef21dc88037d


Actually evaluate a script

Quick change to evaluate a simple Plutarch script.
(This actually fails to evaluate, see #9. Also note that the fib test is failing; all this goes to indicate the importance of #6 )

I want this to be fixed before this is merged, as it's likely evaluateScript that is problematic. If you look at it, you'll notice that it converts it to a named AST, but that conversion isn't actually correct, perhaps because we're calling it wrong. The evaluation should work once you fix that.

I want this to be fixed before this is merged, as it's likely evaluateScript that is problematic. If you look at it, you'll notice that it converts it to a named AST, but that conversion isn't actually correct, perhaps because we're calling it wrong. The evaluation should work once you fix that.

I don't think this is correct. Why do you think evaluateScript (named AST conversion is internal to it) is problematic here? We copied it verbatim (except for error handling, and returning result) from Plutus which uses this function to execute the validator Script (see here and here). Furthermore, Pluto generates the correct Script that executes correctly by evaluateScript as well as by Plutus' emulator and contract test (see here).
My guess was that debruijn index calculation was wrong somewhere, but I'll have to poke a bit more on this.

7661c899958c5c09760efd18fdcaef613f41acaa


Unknown provider error when including dragular library into my dashboard

I am trying to access the dragular library functionality to use drag and drop on my project.
Here is the dashboard I started from
https://github.com/flatlogic/angular-material-dashboard
I installed using bower install after adding this: "dragular": "^4.4.4" at the end of the dependencies
I created a view of my own. The intention is to copy things from view initial List(which will stay as is)
to items1 and item2 lists.

<md-content ng-controller="myController as vm" layout="row" layout-align="center center">

{{item.content}}

{{item.content}}

{{item.content}}

</md-content>

with my controller myController.js being
(function () {
    angular
        .module('app')
        .controller('myController', ['dragularService', function TodoCtrl(dragularService) {
            var vm = this;
            vm.items1 = [];
            vm.items2 = [];
            vm.initialList = [
                {
                    content: 'X'
                },
                {
                    content: 'Y'
                },
                {
                    content: 'Z'
                },
                {
                    content: 'A'
                }
            ];

            dragularService('#left-defaults', {
                containersModel: [vm.initialList],
                copy: true,
                accepts: accepts
            });
        }])})();

when I run using gulp serve.
The page loads but when this controller loads it gives error
dragularServiceProvider <- dragularService <- myController
if I disable then I get dragularService is not defined.
Please help.

Did you include dragularModule as dependency to your app?
var app = angular.module('myApp', ['dragularModule', 'myOtherDependencies']);

Closing as inactive..


Not work for Russian language

I tried to use spotlight for Russian language. I set the Host to both "http://api.dbpedia-spotlight.org/ru/annotate" and "http://model.dbpedia-spotlight.org/ru/annotate", but non of them works! I received the error below:
http://api.dbpedia-spotlight.org/ru/annotate Traceback (most recent call last):   File "/.../testing.py", line 47, in <module>     annot = get_annotations(text)   File "/.../testing.py", line 12, in get_annotations     confidence=0.4, support=20)   File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/spotlight/__init__.py", line 192, in annotate     pydict = _post_request(address, payload, filters, headers)   File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/spotlight/__init__.py", line 51, in _post_request     response.raise_for_status()   File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/requests/models.py", line 939, in raise_for_status     raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 502 Server Error: Proxy Error for url: http://api.dbpedia-spotlight.org/ru/annotate
I would be appreciative if you help me figure out how to solve it.

Hi @zabihimayvan ,
Our online instances was selected considering DBpedia branches that are online - we have noticed that http://ru.dbpedia.org is not available since 2017 :(
Btw, you can run it locally using docker
docker run -d -p 2227:80 dbpedia/spotlight-russian spotlight.sh
and then use it http://localhost:2227/rest/annotate?text=Москва
All the best,

Setting up spotlight using the docker image is really straightforward. The DOCKER_HOST might be different from localhost when using docker-machine.

Hi zabihimayvan, How did you install it? Do you have Jar file?

Unfortunately, I installed the docker file, but it didn't work for me.
Although I really needed the package for Russian language, I ignored it.
Please let me know if you find any solution.
Thanks,
Mahdieh
On Tue, Jul 24, 2018 at 7:51 PM GAUTAM SHAHI<EMAIL_ADDRESS>wrote:

Hi zabihimayvan, How did you install it? Do you have Jar file?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/dbpedia-spotlight/dbpedia-spotlight-model/issues/29#issuecomment-407588123,
or mute the thread
https://github.com/notifications/unsubscribe-auth/Aacm-fh3k_DncUgwN6JrarckvGoymLrCks5uJ7LlgaJpZM4U0UtE
.

Hi,
Thank you.
I am struggling to install it. I will let you know, I am trying to fixed it.
They develop the project for name once the tenure of the project is over
they stop providing the solution.
Then I really don't understand the meaning if open source.
Regards,
On Wed, Jul 25, 2018, 01:54 Mahdieh Zabihimayvan<EMAIL_ADDRESS>wrote:

Unfortunately, I installed the docker file, but it didn't work for me.
Although I really needed the package for Russian language, I ignored it.
Please let me know if you find any solution.
Thanks,
Mahdieh
On Tue, Jul 24, 2018 at 7:51 PM GAUTAM SHAHI<EMAIL_ADDRESS>wrote:

Hi zabihimayvan, How did you install it? Do you have Jar file?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<
https://github.com/dbpedia-spotlight/dbpedia-spotlight-model/issues/29#issuecomment-407588123
,
or mute the thread
<
https://github.com/notifications/unsubscribe-auth/Aacm-fh3k_DncUgwN6JrarckvGoymLrCks5uJ7LlgaJpZM4U0UtE
.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/dbpedia-spotlight/dbpedia-spotlight-model/issues/29#issuecomment-407588630,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADyFFsTOCgMh2TUAgz-XS1xz3pfUC2v6ks5uJ7OYgaJpZM4U0UtE
.

Hi @zabihimayvan
Could you, please, provide us some log to help you?
@Gautamshahi
I totally understand your point but is not fair criticize without to provide a solution. I was paying for years a server to keep these endpoints available online and from I remember, you never asked how you could help on it. Remember: You have what you can pay for.
Best,


Is Couchdb 2.0 supported?

As far as I've used it, it is totally compatible. Since there were no big changes to the authentication/authorization API in CouchDB 2.0, this should really work indeed. SuperLogin behaved the same in CouchDB 1.6.x, CouchDB 2.0.0 and Cloudant.
Have you had any issues?

Cloudant is supported which uses a very similar API to CouchDB 2.0. If you find something specific which doesn't work please file an issue.

Thank you.


Atom crashing with no plugins and no user data, in safe mode

Prerequisites

[x] Put an X between the brackets on this line if you have done all of the following:

Reproduced the problem in Safe Mode: http://flight-manual.atom.io/hacking-atom/sections/debugging/#using-safe-mode
Followed all applicable steps in the debugging guide: http://flight-manual.atom.io/hacking-atom/sections/debugging/
Checked the FAQs on the message board for common solutions: https://discuss.atom.io/c/faq
Checked that your issue isn't already filed: https://github.com/issues?utf8=✓&q=is%3Aissue+user%3Aatom
Checked that there is not already an Atom package that provides the described functionality: https://atom.io/packages

Description
Atom started crashing regularly for me today, so I've been trying to narrow down the cause. Started by disabling all third-party plugins. Then I renamed my user data directory. Finally I tried safe mode. Still crashing. Doesn't require any user interaction, just waiting a few minutes.
Steps to Reproduce

Launch Atom
Wait

Expected behavior:
No crash.
Actual behavior:
Persistent crash.
Reproduces how often:
Every time.
Versions
Atom 1.18
Mac OS 10.12.5
Additional Information
Crash log attached.
atom-crash.zip

Does this happen if you disable the built-in github package?

Tentatively, disabling the github package seems to be improving it. Haven't seen a crash for several minutes. Is that a known issue then?

The crash dump appears to be similar to the one at https://github.com/atom/github/issues/953 which I'm hoping is fixed by the PR that took care of https://github.com/atom/github/issues/959.

Okay, thanks.