Update golang and k8s versions

Description

Update go and k8s versions
Related issues/PRs

Todos

[ ] Tests
[ ] Documentation
[ ] Release note

Release Note

TBD

Reminder for the reviewer
Make sure that this PR has the correct labels and milestone set.
Every PR needs one docs-* label.

docs-pr-required: This change requires a change to the documentation that has not been completed yet.
docs-completed: This change has all necessary documentation completed.
docs-not-required: This change has no user-facing impact and requires no docs.

Every PR needs one release-note-* label.

release-note-required: This PR has user-facing changes. Most PRs should have this label.
release-note-not-required: This PR has no user-facing changes.

Other optional labels:

cherry-pick-candidate: This PR should be cherry-picked to an earlier release. For bug fixes only.
needs-operator-pr: This PR is related to install and requires a corresponding change to the operator.

Latest k8s v1.26 release is at v1.26.8.

Created https://github.com/projectcalico/calico/pull/8032 for release-v3.26 branch to decouple kindest/node version and K8S_VERSION.


improve controlled UnitaryGate (issue #10313)

Summary
resolves #10313
Details and comments

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

4 of 4 (100.0%)  changed or added relevant lines in 2 files are covered.
14 unchanged lines in 5 files lost coverage.
Overall coverage increased (+0.03%) to 85.978%

Files with Coverage Reduction
New Missed Lines
%

qiskit/transpiler/passes/synthesis/unitary_synthesis.py
1
90.18%

qiskit/extensions/quantum_initializer/squ.py
2
80.0%

crates/accelerate/src/vf2_layout.rs
3
94.74%

crates/accelerate/src/sabre_swap/layer.rs
4
97.32%

crates/qasm2/src/lex.rs
4
90.63%

Totals

Change from base Build<PHONE_NUMBER>:
0.03%

Covered Lines:
71494

Relevant Lines:
83154

💛  - Coveralls

I tried to look at the test that's failing: test_controlled_random_unitary. It seems to only be failing sometimes, and with random num_ctrl_qubits values, so it seems to be just failing with certain random unitary. I'm not sure what to look for to see what's causing the issue though.

Hey Danielle - the root cause of this is probably going to be very very maths-y; this PR is switching the particular mathematical way that we turn a large unitary matrix into a series of 1q rotations and cx gates.
That said, if you're able to pull out the test case into a function you can run yourself, what could be useful is if you can keep trying to generate random matrices, seeing if the test fails, and if it does, save the matrix that caused a failure.  Then we can compare the input matrix to the output one, and see how exactly they differ.  The reason it only happens sometimes is because the test that failed is a deliberately stochastic test (if I remember correctly - the CI logs have unfortunately just timed out), so they're not always taking the exact same input.

Hey Danielle - the root cause of this is probably going to be very very maths-y; this PR is switching the particular mathematical way that we turn a large unitary matrix into a series of 1q rotations and cx gates.
That said, if you're able to pull out the test case into a function you can run yourself, what could be useful is if you can keep trying to generate random matrices, seeing if the test fails, and if it does, save the matrix that caused a failure. Then we can compare the input matrix to the output one, and see how exactly they differ. The reason it only happens sometimes is because the test that failed is a deliberately stochastic test (if I remember correctly - the CI logs have unfortunately just timed out), so they're not always taking the exact same input.

okay, the math is definitely not for me, but I saved 10 runs that fail the check and saved the matrices in a txt file (not sure if this is the best way to save them)

Danielle: thanks for those matrices! Do you remember exactly how you were generating the failing matrices?  I can't reproduce failures for your examples locally (though that doesn't necessarily mean much).
Erick: have you got a handle on the errors here?  We want this merged before Thursday, so there's not much time.

Danielle: thanks for those matrices! Do you remember exactly how you were generating the failing matrices? I can't reproduce failures for your examples locally (though that doesn't necessarily mean much).
Erick: have you got a handle on the errors here? We want this merged before Thursday, so there's not much time.

Yeah, I added the code I used to generate the matrices here, I just copied the code from the test that was failing (test_controlled_random_unitary in test/python/circuit/test_controlled_gate.py) and hard coded the num_ctrl_qubits value to 4

Thanks Danielle - I was able to use your script to pull out this simple reproducer:
import numpy as np
from qiskit.extensions import UnitaryGate
from qiskit.quantum_info import Operator
from qiskit.circuit._utils import _compute_control_matrix

arr = np.array([
    [ 0.24143660322204608  -0.17837176842138808j ,  0.0012620688405012015+0.6292301735551137j  ,  0.2318008582154029   +0.007109583062398575j, -0.4038565407946165   +0.5450480576440556j  ],
    [ 0.5997114346071216   +0.19787353071578223j ,  0.5543533744027408   -0.3318786154078365j  ,  0.011738816936537264 -0.19511570580301024j , -0.369416232845299    -0.09520971800778474j ],
    [ 0.27526558558009234  +0.15375694053652283j , -0.09010222889095292  +0.30654787299690395j , -0.86215553331598     -0.16045292810241327j ,  0.15998865823617336  +0.06199979043385605j ],
    [ 0.16199499455541133  -0.6208296241880331j  ,  0.018263407685368382 +0.29016056700211623j ,  0.07571248935598604  -0.36499341182646655j ,  0.04755150675507683  -0.6021526179054468j  ],
])

exact = _compute_control_matrix(arr, 4)
qsd = Operator(UnitaryGate(arr).control(4)).data

np.testing.assert_allclose(exact, qsd, rtol=1e-10, atol=1e-8)

Erick: the output matrix from the QSD is significantly different in absolute values in what looks on the surface like a fairly blocky structure.  Looks like an actual numerics problem, not just test tolerances.

Never mind - CI has flagged a potential flakiness in one of the TestControlledGate tests, so I'll remove this from the merge queue.  We can look at it more, and potentially get this merged in as a bugfix (with respect to it making us more robust against Numpy 1.25's issues) within the rc1 period over the next week.

I added some checks to catch synthesis errors. There is likely a performance conseuquence to this. One was tracked to the cosine-sine decomposition of scipy. Error could be of order 1e-3. One was in the eigen decomposition of scipy; errors were of order 1e-7. One seemed to occur in the two_qubit_cnot_decomposer for matrices of the form,
            ┏         ┓
            ┃ A     0 ┃
            ┃ 0     c ┃
            ┗         ┛

where A is in U(3) and c is a complex number with magnitude 1. Again errors were of order 1e-7. It is possible that all these apparent errors have a single cause related to scipy/numpy.

This is probably too invasive for stable/0.46, right?

@Mergifyio backport stable/0.46 stable/1.1


feat(s2n-quic): allow disabling active connection migration support

Description of changes:
This change adds a with_connection_migration(enabled: bool) setting to the default connection limiter provider. When set to false, the disable_active_migration transport parameter will be sent to the peer, and any attempt by the peer to perform an active connection migration will be ignored.
The definition of "active connection migration" is the peer sending from a different source address while also changing the destination connection ID it was using previously. This is in contrast to a passive cnonection migration (caused by a NAT rebind or similar), where the peer would not know its source address changed, and thus would not change the destination connection ID.
Call-outs:
I went back and forth on whether this belonged in the path migration validator provider, but ultimately decided against it since:

The path migration validator provider is not currently exposed as an option when building an endpoint
Even if it was exposed, the logic of determining if a connection migration attempt was "active" or not is not something that should be left up to the application, as it is internal to QUIC.

Testing:
Added unit tests
Is this a refactor change? If so, how have you proved that the intended behavior hasn't changed? -->
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Kani failures will be fixed by https://github.com/model-checking/kani/pull/3144


Profile customize cell's affection ratio by full/delta traffic data

This task is part of #30, for more background please go to: https://github.com/Project-OSRM/osrm-backend/issues/5503
We noticed that OSRM will customize all cells during each round of customization, it tasks 10% of total time to load updated speed data, 30% to re-load OSRM data, 60% to do customization.
We want to know if with partial traffic + only customize cells with updated traffic, whether the time cost could dramatically dropped.

For current OSRM's logic, in cell_customizer.hpp it will customize all cells from level 1 to level 4
    template <typename GraphT>
    void Customize(const GraphT &graph,
                   const partitioner::CellStorage &cells,
                   const std::vector<bool> &allowed_nodes,
                   CellMetric &metric) const
    {
        Heap heap_exemplar(graph.GetNumberOfNodes());
        HeapPtr heaps(heap_exemplar);

        for (std::size_t level = 1; level < partition.GetNumberOfLevels(); ++level)
        {
            tbb::parallel_for(tbb::blocked_range<std::size_t>(0, partition.GetNumberOfCells(level)),
                              [&](const tbb::blocked_range<std::size_t> &range) {
                                  auto &heap = heaps.local();
                                  for (auto id = range.begin(), end = range.end(); id != end; ++id)
                                  {
                                      Customize(
                                          graph, heap, cells, allowed_nodes, metric, level, id);
                                  }
                              });
        }
    }

Our idea is, when apply live traffic to each node, recording the cell id touched by him.
In updater.cpp
if (auto value = segment_speed_lookup({u, v}))
{
	// update set<cellId> covered by u & v
	// for each node, need to find all upper level celles
}

if (auto value = segment_speed_lookup({v, u}))
{
	// update set<cellId> covered by v & u
	// for each node, need to find all upper level celles
}

Class MultiLevelPartitionImpl(view) provide ability to get CellID by given node and level.
    // returns the index of the cell the vertex is contained at level l
    CellID GetCell(LevelID l, NodeID node) const

The set will be transferred to Customize, during iteration, when cellid not in the set directly skip.
The main point is output statistic of delta change ratio.
class CellFilter
{
	void Initialize();

	void Clear();

	// if cell need to be filtered
	// return true means cell hasn't be touched
	// return false means cell has been update, no need touch
	bool Filter(CellID id);

	// update all cells cover given node
	void Update(NodeId s);
}

For how customization works, please refer to here:
https://github.com/Telenav/osrm-backend/issues/55#issuecomment-525062173

Several notes about the profile:
Requirements

The profile should not affect original logic.  Means it should be configurable, by default should be the same as old logic(customize all cells)
The change should be testable

Notes

About where to add class CustomizerCellFilter, now I am thinking in CellCustomizer
There should be a factory to create different CustomizerCellFilters, by default Filter will always return false
During code debugging, I pay more attention to the parameter of 'allowed_nodes' for function call Customize().

allowed_nodes is used for "avoid_toll" or "avoid_highway".
The vector of allowed_nodes matches each nodeid
There could be several allowed_nodes vector and will generate different metrics
For each node, the value of allowed_nodes set to false means such node is excluded from graph.  During route calculation will skip such node, and if such node is the boundary node of the cell, during customization will assign "INVALID_EDGE_WEIGHT" to the in&out value
classes has been set during lua import, for 'toll', 'motorway', 'ferry', 'restricted', 'tunnel'
API of Customize()

    template <typename GraphT>
    void Customize(const GraphT &graph,
                   const partitioner::CellStorage &cells,
                   const std::vector<bool> &allowed_nodes,
                   CellMetric &metric) const

Customize for different metrics
std::vector<CellMetric> customizeFilteredMetrics(const partitioner::MultiLevelEdgeBasedGraph &graph,
                                                 const partitioner::CellStorage &storage,
                                                 const CellCustomizer &customizer,
                                                 const std::vector<std::vector<bool>> &node_filters)
{
    std::vector<CellMetric> metrics;

    for (auto filter : node_filters)
    {
        auto metric = storage.MakeMetric();
        customizer.Customize(graph, storage, filter, metric);
        metrics.push_back(std::move(metric));
    }

    return metrics;
}

How node_filter is constructed
inline std::vector<std::vector<bool>>
excludeFlagsToNodeFilter(const NodeID number_of_nodes,
                         const extractor::EdgeBasedNodeDataContainer &node_data,
                         const extractor::ProfileProperties &properties)
{
    std::vector<std::vector<bool>> filters;
    for (auto mask : properties.excludable_classes)
    {
        if (mask != extractor::INAVLID_CLASS_DATA)
        {
            std::vector<bool> allowed_nodes(number_of_nodes);
            for (const auto node : util::irange<NodeID>(0, number_of_nodes))
            {
                allowed_nodes[node] = (node_data.GetClassData(node) & mask) == 0;
            }
            filters.push_back(std::move(allowed_nodes));
        }
    }
    return filters;
}

For unit test, I think cell_customization.cpp gives me a good example.
First I will write a file to test customization when speed value changes.
Then when the filter is enabled, the customization result is still correct.

Back to real world. :):)
Current logic

In customizer.cpp, it will call LoadAndUpdateEdgeExpandedGraph to load data from csv and update edge expand graph
Then will call customizeFilteredMetrics to update all metrics' cost

Inside LoadAndUpdateEdgeExpandedGraph, it will call updateSegmentData and updateTurnPenalties in updater.cpp to update cost for segment and tuns

Please note that LoadAndUpdateEdgeExpandedGraph will also be called by contractor

Potential change

During customizeFilteredMetrics, avoid customize the cells hasn't been touched
Use CustomizerCellFilter to record which cell has cost change
In LoadAndUpdateEdgeExpandedGraph, record all nodes been touched, using set or unordered_set
In customizer.cpp, based on the nodes been touched, generated cells coverred such nodes
In  CustomizerCellFilter, avoid touching related cells

Main changes

During parseArguments in customize.cpp, add new boolean flag of incremental to indicate whether rebuild cost metrix or incrementally build metrix.  By default its false means the same as original version.
During Customizer::Run, if config.updater_config.incremental is false, same as before.  util::ConcurrentSet<NodeID> node_updated will not collect any updated node ids, and CellUpdateRecord cell_update_record will always return true for Check() which means all cells need to be Customized.
During Customizer::Run, if config.updater_config.incremental is true, will load cell_metrics from file and only change the part need to be updated.  util::ConcurrentSet<NodeID> node_updated will collect all nodes which have speed update, then CellUpdateRecord cell_update_record will collect all cell ids covered those nodes, during Customization, when iterating all cells, we only recaculate cost for cells inside cell_update_record
Finally will persistent metrix into files

Testing

unit test for ConcurrentSet
unit test for CellUpdateRecord
test for the flag of incremental
generate sample speed.csv, verify cell customization as expected, only affect cell has been updated, final metrix has been recorded.

Old logic
https://github.com/Telenav/open-source-spec/blob/master/osrm/references/pictures/osrm_customization_old.png
New logic
https://github.com/Telenav/open-source-spec/blob/master/osrm/references/pictures/osrm_customization_new.png

During 09/27/2019's testing, I met a core dump in docker, cannot reproduce which on osx.
Segmentation fault (core dumped)

Testing description
Using osrm-professional-na's data + tomtom traffic.
step 1: generate full metric
step 2: get partial traffic data and using incremental mode to generate new metric.

I use entire day to debug and trace code for root cause, finally add one line of code and I am pretty happy I got more deep understanding for extraction and partition.
Root cause
During node collection, we will collect inner nodes which don't have CellID, and during the function call of GetCell it crashed.
    CellID GetCell(LevelID l, NodeID node) const
    {
        auto p = partition[node];
        auto lidx = LevelIDToIndex(l);
        auto masked = p & level_data->lidx_to_mask[lidx];
        return masked >> level_data->lidx_to_offset[lidx];
    }

    Vector<PartitionID> partition;

The parameter passing into is (1, 4561984) while the array of partition only has 4288115 elements.  Add following code is needed protection
    CellID GetCell(LevelID l, NodeID node) const
    {
        if (node > partition.size() || l > GetNumberOfLevels())
            return INVALID_CELL_ID;

But to make sure we don't have bugs in other places I have a reading and debugging on OSRM's code.
Question 1: whether all nodes have cellid?
No.  For example, based on the sample data testing
[info] Loaded compressed node based graph: 4490432 edges, 16637952 nodes

While for the array of partition there are only 4288115 cells.
Question 2: Why So?
OSRM::Partition
Partition mainly depend on the following 3 files as input
    if (!check_file(partition_config.GetPath(".osrm.ebg")) ||
        !check_file(partition_config.GetPath(".osrm.cnbg_to_ebg")) ||
        !check_file(partition_config.GetPath(".osrm.cnbg")))

What are they?
OSRM::Extractor
The entrance is
int Extractor::run(ScriptingEnvironment &scripting_environment)

Step 1
First construct node based graph
    NodeBasedGraphFactory node_based_graph_factory(config.GetPath(".osrm"),
                                                   scripting_environment,
                                                   turn_restrictions,
                                                   conditional_turn_restrictions,
                                                   unresolved_maneuver_overrides);

The most important step inside is compress, which combine degree 2 vertices, delete data from original graph and combine data into start node.
void GraphCompressor::Compress()

In the end of this step it will generate NodeBasedDynamicGraph.
using NodeBasedDynamicGraph = DynamicGraph<NodeBasedEdgeData>;

DynamicGraph is the graph contains node/edge information, plus it support add/delete operation, that's why its name is Dynamic.
template <typename EdgeDataT> class DynamicGraph
{
    NodeIterator number_of_nodes;
    std::atomic_uint number_of_edges;

    std::vector<Node> node_array;
    DeallocatingVector<Edge> edge_list;

    EdgeRange GetAdjacentEdgeRange(const NodeIterator node) const
    {
        return irange(BeginEdges(node), EndEdges(node));
    }

Final result dump into file of cnbg
    files::writeCompressedNodeBasedGraph(config.GetPath(".osrm.cnbg").string(),
                                         toEdgeList(node_based_graph));

EdgeList is {}
struct CompressedNodeBasedGraphEdge
{
    NodeID source;
    NodeID target;
};

In my sample data, it shows there are high node and edge compression ratio, which means lots of nodes are combined and edges has been deleted.
[info] Node compression ratio: 0.161598
[info] Edge compression ratio: 0.205774

Step 2
EdgeID Extractor::BuildEdgeExpandedGraph calls void EdgeBasedGraphFactory::Run
Step 2.1
Generate nodes based graph mapping, the final result will sort node id and only record the one "end node id " > "from node id".  Final result has been wrote to cnbg.
files::writeNBGMapping(cnbg_ebg_mapping_path, mapping);

struct NBGToEBG
{
    NodeID u, v;
    NodeID forward_ebg_node, backward_ebg_node;
};

Step 2.2
void EdgeBasedGraphFactory::GenerateEdgeExpandedEdges

Two graphs, FYI:

osrm-extract Startup and Process Call Graph
osrm-customize Startup and Process Call Graph

Still have questions:

why not all edges/nodes in cells?
what's the compression ratio mean? remain / all or (all - remain) / all ?

Still have questions:

why not all edges/nodes in cells?
I think you mean, during collection, why not only collect nodes/edges in cell.
If so, I think it depends on where we want to handle this part of logic:
The input contains all edges which contains traffic update
During customization, it will update original graph for the cost/travel time part, along with this part of logic I implement the code of collecting changed node id.  This part I just want to collect raw node id be changed which has similar purpose with context.
Then I will iterate all nodes in the set and try to find cell id for them, I want to handle logic in this part: node id which in the final cell will be collect cell id, while node id already be combined will return invalid_cell_id
In the last step, during customization, I will check whether cell id has node be updated, if so, then will customize which, otherwise will skip customization.

what's the compression ratio mean? (remain / all) * 100 or ((all - remain) / all) * 100 ?

compression ratio means remain/all.  Most of original edges from OSM data will be combined.

Two graphs, FYI:

osrm-extract Startup and Process Call Graph
osrm-customize Startup and Process Call Graph

Thanks for the graph.  Another thing I think is very important is why create those data structures.
https://github.com/Project-OSRM/osrm-backend/wiki/Toolchain-file-overview
https://github.com/Project-OSRM/osrm-backend/wiki/Processing-Flow
Those two wiki also helps, but need additional effort to map with existing code.

Still have questions:

why not all edges/nodes in cells?

I think your question is, during collection, why not only collect nodes/edges in cell.
If it is, I think it depends on where we want to handle this part of logic:

The input contains all edges which contains traffic update
At beginning of customization, it will update original graph for the cost/travel time part, all nodes and edges no matter its combined or not will be updated if there is speed update in the input file.  Along with this part of logic I implement the code of collecting changed node ids.  This part I just want to collect raw node id be changed which has similar purpose with context.  There is no concept of cell/mlp in this part.
Then I will iterate all nodes in the set and try to find cell id for them, node id which in the cell will collect cell id, while node id already be combined will return invalid_cell_id because there is no cell id for them
In the last step, during customization, I will check whether cell id exists in the upper step, if so which means there are node be updated inside and its cost need to be updated thus need customize function, otherwise will skip customization for the cell.

No, my question is why the nodeid can be bigger than cell's length in
    CellID GetCell(LevelID l, NodeID node) const
    {
        if (node > partition.size() || l > GetNumberOfLevels())
            return INVALID_CELL_ID;

Does this mean some node will not in cell? Are they abondanded? Or something else?

Still have questions:

why not all edges/nodes in cells?

I think your question is, during collection, why not only collect nodes/edges in cell.
If it is, I think it depends on where we want to handle this part of logic:

The input contains all edges which contains traffic update
At beginning of customization, it will update original graph for the cost/travel time part, all nodes and edges no matter its combined or not will be updated if there is speed update in the input file.  Along with this part of logic I implement the code of collecting changed node ids.  This part I just want to collect raw node id be changed which has similar purpose with context.  There is no concept of cell/mlp in this part.
Then I will iterate all nodes in the set and try to find cell id for them, node id which in the cell will collect cell id, while node id already be combined will return invalid_cell_id because there is no cell id for them
In the last step, during customization, I will check whether cell id exists in the upper step, if so which means there are node be updated inside and its cost need to be updated thus need customize function, otherwise will skip customization for the cell.

No, my question is why the nodeid can be bigger than cell's length in
    CellID GetCell(LevelID l, NodeID node) const
    {
        if (node > partition.size() || l > GetNumberOfLevels())
            return INVALID_CELL_ID;

Does this mean some node will not in cell? Are they abondanded? Or something else?

Not all node from osm data have related cellid.  The comments there are explaining this.

Profile result
If traffic update frequency is about 30 seconds, total nodes in the graph be updated is 0.1%, about 3%'s cell need to be customized
If traffic update frequency is about 120 seconds, total nodes in the graph be updated is 1%~2%, about 25%'s cell need to be customized
If traffic update frequency is about 30 seconds, total nodes in the graph be updated is 2.5%, about 35%~38%'s cell need to be customized


Fix #1638 Documentation Does not work for Azure Data Studio extensibility

Updated the tools with new names
Updated documentation to reference those names
Updated screenshot for accuracy
Fixed 1 issue where "SQL Operations Studio" was used instead of "Azure Data Studio"

Microsoft authors of articles need to make updates through the private repository so the updates can be staged and validated by the current validation rules. After you review staging and fix all validation issues, you can add the sign-off comment to let the PR reviewers know the updates are ready to be merged.It's easy to access the private repo version of your articles in GitHub. Just add -pr to the URL, as follows:
Public repo URL: https://github.com/Microsoft/azure-docs/blob/master/articles/azure-portal-overview.md
Private repo URL: https://github.com/Microsoft/azure-docs-pr/blob/master/articles/azure-portal-overview.md
We have closed this pull request. Please resubmit the updates through the private repo. If you need perms to the private repo, see the contributor guide instructions


Add IntoIter impl for FeatureCollection

so you can:
for feature in &feature_collection {
    handle_feature(feature)
}

bors r=urschrei


Vote for committership for balaji

@prazanna @n3nash Starting a vote on @bvaradar 's contributions to hoodie so far.. Docker setup, dependency cleanup, async compaction are some major improvements already merged and validated.
Please chime in with your vote

+1 from me

+1 from me!

Alright.. its settled then!


Add an application programming interface (API)

Add an application programming interface (API) to allow external systems to consult the bot's database and facilitate the extraction of information and the construction of dashboards related to the metrics of use and exchange of money in the system.

I've created an PR 236


README: Add extra run instructions for running without V in PATH

A lot of people use V as an executable so this pull request adds instructions to run py2v that way.

Instead of a new header to the readme, could you add instructions to only compile json2v at the end of the Installation header? The bash script won't invoke V if json2v is already compiled.

good point I'll fix that

That look good?


test

Hello. Could you please delete this issue? Because I don't want to continue
to be an issue in my top repertoire.
2023년 2월 4일 (토) 오후 10:31, Olivier Tassinari @.***>님이 작성:

Closed #36049 https://github.com/mui/material-ui/pull/36049.
—
Reply to this email directly, view it on GitHub
https://github.com/mui/material-ui/pull/36049#event-8438577186, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AWVVN7GQK5I4TZL7S5I4I63WVZK25ANCNFSM6AAAAAAURBB2ZU
.
You are receiving this because you authored the thread.Message ID:
@.***>


Update Korean localization for v1.19

This is a Clean Up Request

What would you like to be added
Update the Japanese localization for changes since v1.18
Why is this needed
The Japanese documentation is largely based on documentation for older versions of Kubernetes. Ideally, the master-branch documentation would include the changes that were made for the v1.19 release, including feature gate status and feature-state details within pages.
Comments
Maybe some tooling could help to detect which changes need making, perhaps even to recommend the replacement?
/language ko
/kind cleanup

@sftim We've done for this. #23533
This PR will merge to master within this week.

Is this OK to close?

@sftim Yes, close please.

@sftim Thank you for checking outdated contents in Korean docs!
(Thank you. quick response ! @pjhwa)
I guess this issue is about Korean l10n not about Japanese l10n.
(the description of this issue mentions Japanese l10n)
Korean l10n team has updated outdated files for Korean contents (1.18->1.19, PR: #23702)
[FYI] Korean l10n team uses a script to check outdated contents as follows.
python3 scripts/diff_l10n_branches.py ko dev-1.18-ko.10 dev-1.19-ko.1

Also, the Korean work branch (dev-1.19-ko.1) has been merged into master branch. (PR: #23814) Currently, we can check the updates through the Website.
So, I think this issue can be closed. Thank you!

/close


Bug fix in 'Tensor.batchGathering'

Tensor.batchGathering was not properly handling negative axis arguments.

@asuhan
I think ternary operator is more desirable.
Even if the axis is not less than rank (so it is not in range [-rank, rank)), modulo operator wraps it into [0, rank).


Some graphs going back into the past?!

Looking at some graph like building:use it produces very strange results, where graph goes backwards in time (timewarping from 2019 back to middle of 2018), and then becomes  dotted line for years?
See here: https://taghistory.raifer.tech/#***//building:use

Is it some database corruption or?

Anyway, that specific issue seem to be caused to caused by erroneous slash in URL. Why it displays anything resembling normal data up to 2018 is misleading. E.g.

this works: https://taghistory.raifer.tech/#***/building:use/

this goes crazy: https://taghistory.raifer.tech/#***//building:use

Also note that this seems to be related, but separate issue from the less-popular tags not being updated after mid-2018 (e.g. like in https://taghistory.raifer.tech/#/leisure/swimming_pool&/amenity/swimming_pool) which seems to be design decision


! return type causes confusion

e.g.,
fn foo() -> ! {}

gives Couldn't make snippet for span Loc { file: FileMap(tests/source/structs.foo), line: 1, col: CharPos(15) }->Loc { file: FileMap(tests/source/structs.foo), line: 1, col: CharPos(14) }

There seems to be some bad spans here - both the surrounding module and the name of the function seem to have incorrect spans.

FIxed

We should probably have a regression test for this at some point.


Scanbuild warning fixes

Fixes a lot of warnings found during scanbuild
Fixes some formatting issues in files touched
Fixes #4234

I'm bothered that this PR has been merged so fast.
Static analysers have their good part, but I don't think we should change the code to please them when it's just some case that they don't detect correctly.
I'm really annoyed by all these initializations and checks that are sometime unneeded, but just added to have a clean clang-scanbuild result.


Use NuGet's fork of NuGet.Client in source-build submodule

We had to switch to my fork in https://github.com/dotnet/source-build/pull/94. Should be able to switch back if we move to a newer NuGet.Client commit that doesn't have the FileSystem submodule problem. (A branch disappeared that I had to revive in my own FileSystem fork.)

I see--to connect things together, the NuGet.Client commit brought in by https://github.com/dotnet/source-build/pull/123 got us to a cloneable commit.


Move file from private repo to public repo

Any changes needed?

readme
travis.yml

documentation for sure. and syntax checking.


Rework SourceFile analysis strategy

Right now JS-X-Ray is only capable to scan one sourcefile by one sourcefile. The Scanner package is currently responsible of listing and iterating all JavaScript files from a given NPM tarball (for example).
What's the issue with that?
index.js
src/
  other.js
test/
  foobar.js

In the example above we will scan every files. But in reality there is a high probability that test/foobar.js will never be executed (and it will also be the biggest vector of false positives).
My idea is to add a new strategy that will take entry files as input. We will then only scan files imported from these entry points.
Eventually, we could combine the two ways of doing things to ensure greater security while reducing false positives overall.

My idea is to add a new strategy that will take entry files as input. We will then only scan files imported from these entry points.
Eventually, we could combine the two ways of doing things to ensure greater security while reducing false positives overall.

I'd make this feature (or the current default behavior) optional, if users still want to check all the files indiscriminately, this should be a possibility for them.

I take this one.


Add Busy/Idle metric for compactors

Is your feature request related to a problem? Please describe.
When performing a scale-in operation, only compactors that are not performing compactions should be candidates for removal.
Currently, a combination of using jstack and looking for a MajC thread can help determine if a compactor is performing work.
Describe the solution you'd like
The compactor should emit a metric value to determine if it's currently working or idle.
This metric can then be used to drive scaling decisions and/or rolling compactor updates.

I can take a look at this


Duplicated entries in repos.txt lead to unnecessary warnings

If you have a long list of repos created manually, it's easy to add duplicates :)
Then turbolift would complain every time an action would be executed.
I can provide a fix for that if you would be interested

Yes please, we happily accept contributions!


Attempt to fix ClearCache.

#576

Merging this in too fast, can create forks.

Do we hold on to this until a mandatory?

Now I'm confused.

Merging this in too fast, can create forks.

Hence my question. Do we or don't we?

I don't know. It looks like mandatory change (superblocks being rejected).


dotnet watch run says the specified framework 'Microsoft.NETCore.App', version '1.0.0' was not found.

When I run dotnet watch run command I get following error

Check application dependencies and target a framework version installed at:
/usr/local/share/dotnet/shared/Microsoft.NETCore.App
The following versions are installed:
1.1.0
Alternatively, install the framework version '1.0.0'.

"tools": {
        "Microsoft.DotNet.Watcher.Tools": "1.0.0-preview2-final"
 },

$ dotnet --info
.NET Command Line Tools (1.0.0-preview2-1-003177)

Product Information:
 Version:            1.0.0-preview2-1-003177
 Commit SHA-1 hash:  a2df9c2576

Runtime Environment:
 OS Name:     Mac OS X
 OS Version:  10.12
 OS Platform: Darwin
 RID:         osx.10.12-x64

& when I changed project.json file to
"tools": {
        "Microsoft.DotNet.Watcher.Tools": "1.1.0-preview2-final"
 },

& then hit dotnet watch run followed by dotnet restore. I don't see this error but then when I edit wwwroot/main.css & add background color and hit browser refresh nothing happens. I have still stop server and restart server to see the changes

Download and install .NET Core 1.0: https://www.microsoft.com/net/download/core or change to "1.1.0-preview4-final". See https://www.nuget.org/packages/Microsoft.DotNet.Watcher.Tools/ for list of available versions

@natemcmaster I have changed to "Microsoft.DotNet.Watcher.Tools": "1.1.0-preview4-final" but when run dotnet watch run & change css file & refresh browser page. Nothing happens
Does it work only with html pages? What about css & js change or assets(images, icons) etc?

By design, dotnet watch for project.json won't trigger a restart of your web app when .css/.js/images etc change. Just files used by the C# compiler.
dotnet watch for MSbuild (the new thing we are working on) let's you customize which files are being watched. See https://github.com/aspnet/DotNetTools/blob/dev/src/Microsoft.DotNet.Watcher.Tools/README.md#msbuild
Re: browser doesn't show updates. Because dotnet-watch didn't restart, I would assume the issue exists when you do dotnet run too. Try a "hard refresh" to ensure the browser isn't caching results.
Closing the issue for now. Feel free to continue discussion. Not trying to be mean, but it seems we solve the original issue you described, and we will not longer issuing updates to the project.json version of dotnet-watch.
-Nate


Merge cells

How can I use colspan and rowspan

@1990prashant is it supported by https://github.com/randym/axlsx? If so could you provide an example of what you're trying to do?

Closing due to lack of details.


u8ArrayToString creates invalid utf8 strings

Since it's unchecked, the strings created by it will be invalid strings. Unsure if this is lossy if JS keeps the internal bytes, but this seems unsafe to do.
The issue seems to be also if you're trying to parse a non unicode/utf8 character for the other side of this conversion that there will be an overflow. Unsure how the jsvm handles this tested and seems this just overflows, so someone could potentially overwrite values they don't have permissions for

It's more like a problem of the documentation. u8ArrayToString is creating bytes, although internally it's still JS String object. So it doesn't guarantee UTF-8 validity, just like you can write any binary sequence with host function write_storage in rust-sdk. Maybe this should be named u8ArrayToBytes and provide a checked version that does u8ArrayToString

No it's not just documentation, you can repro the overflow pretty easily:
let initial = "😇";
console.log(initial);
// 😇
let arr = stringToU8Array(initial);
console.log(arr);
// [61, 7]
let s = u8ArrayToString(arr);
console.log(s);
// =

If you consider u8ArrayToString is actually u8ArrayToBytes, you know it's the expected behavior

@austinabell Please check the fix, thanks! Also, the new interface will indicate this is no longer a valid input:
let initial = "😇";
console.log(initial);
// 😇
let arr = bytesToU8Array(initial);

Bytes must be a string containing only \x00 to \xff chars.

re-opened because the bug was not fixed:
let initial = "😇";
console.log(initial);
// 😇
let arr = bytesToU8Array(initial);
console.log(arr);
// [61, 7]
let s = u8ArrayToBytes(arr);
console.log(s);
// =�

@austinabell
No it's fixed, the snippet above is the unexpected way to use it (I should have this documented in README),
bytesToU8Array expect a bytes, not a JS String. With current API, the safe mode is user should wrap bytes with bytes API: bytesToU8Array(bytes(initial)), and this will fail (bytes will check if every byte in the initial is between --255). For the unsafe use, user need to ensure what passed to bytesToU8Array is really a valid bytes, while the above snippet doesn't hold.
This is like all other JS library which needs to enforce the type. JS doesn't have compile time type check, so either it can be enforced via documentation or runtime checks. For smart contract, runtime check everywhere can be expensive to experienced users, so we provide the both safe and unsafe path.

Also, as you noticed, the function in other way is now called: u8ArrayToBytes instead of u8ArrayToString. It's by design to return bytes instead of string. So the reverse way is also not a bug.
See:
https://github.com/near/near-sdk-js/pull/103
https://github.com/near/near-sdk-js/blob/37965b8b1f5f467761938229fedf9cd0532cfd24/README.md?plain=1#L81

As we intentionally dropped u8ArrayToString, and what bytesToU8Array provided behavior is right, I'm closing this issue. As Austin Abell said, all bytes function can't prevent misuse by passing a string, include bytesToU8Array, which is tracked on #117


pull request for e2e test at 01/12/2017 16:56:13

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add condition and command support to watch command

watch is the only breakpoint command that doesn't support condition and command options (if, do, and pre). It's not by design and the inconsistency between it and other commands may confuse the users. So after discussing with @ko1, we're supporting those options on watch too.

I think the binding for condition evaluation needs more work.


VirusTotal detecting packages made with Platypus as infected

https://virustotal.com/en/file/0ca63310d0fc2a0e708688c280d9b683155a2edb3c51be44e3e6c1fb6fe2c31a/analysis/1496745070/
False positive? This effects every package made with Platypus.
I even tested just uploading using url directly from platypus website, making sure my own system was not involved in between.

Yeah, definitely false positive. Curiously, it has no issue with http://sveinbjorn.org/files/software/platypus.zip but doesn't like it when I upload a zipped Platypus.app.


Update diffusive DA to enable V3 exec pathway

In order to enable simulations through the looped V3 execution pathway, we need to pass LastObs data from cython to compute.py. Our first implementation of DA in diffusive.pyx and diffusive_cnt.pyx did not gather and return LastObs data, which caused the V3 execution pathway to fail.

To test the V3 execution pathway with the diffusive wave model, run these two .yaml files (with this branch checked out). You will absolutely need to recompile before running, as all of the changes are in cython code.

/glade/u/home/adamw/projects/t-route/test/jobs/V03/Flat_River_test_CNmod_V3_loop.yaml
/glade/u/home/adamw/projects/t-route/test/jobs/V03/Tar_River_test_CNT_V3.yaml

known issue
Due to how time is handled in the CNT model, the looped solution does not match a non-looped solution for the timesteps immediately following the start of a loop iteration. In a nutshell, all flow computations in a repeatInterval are calculated assuming the same channel depth, diffusivity, and celerity state. We are in the process of addressing this issue to changing the model to calculate depth, diffusivity, and celerity at each timestep that flow is calculated. While this outstanding issue affects model accuracy - it does not affect stability.

Merged #454 -- rebase is clean on top of that.
Test files both execute -- Flat river is completely clean; Tar river runs with a few depth iteration warnings.


Incorrect token reference in hmanzur/actions-set-secret

https://github.com/ericanastas/deploy-google-app-script-action/blob/051d5732de716820b4f928bd9f9e3befd7441f80/.github/workflows/deploy-script.yml#L47
Should be token: ${{ secrets.CLASPRC_JSON }}

No it shouldn't.
token is the token used to access the github repo and thus should be set to REPO_ACCESS_TOKEN


Add list templates

Adds the ability to list templates (enhancement #35 ) using a flag with tthe existing flavours list command.
example usage is shown below
❱ flavours list --templates
alacritty amfora binary-ninja blink ...

globbing still works, and -t works as short for --templates as you'd expect
❱ flavours list -t "i3*"
i3 i3status i3status-rust

including the '/templates/' (or just '/' as shown later) lists subtemplates
❱ flavours list -t "i3*/templates/*"
i3/bar-colors i3/client-properties i3/colors i3/default i3/nebi3 i3status-rust/default i3status/default

note adding the .mustache extension to the end of the glob will produce the same output and is therefore optional
also note that the intermediary '/templates/' is NOT included in the output. This was done on purpose to make it easier to read, however I can imagine it causing some confusion because the output doesn't represent the actual file structure. I'm happy to figure out a different solution if this is a concern
To make it easier I made it so globs with a single '/' have the slash expanded to '/templates/' .
❱ flavours list -t "i3*/*"
i3/bar-colors i3/client-properties i3/colors i3/default i3/nebi3 i3status-rust/default i3status/default

OMG, @probably-neb this is amazing! Thank you! :beers:

Merging now, thanks again!
(Pushed to fix some conflicts)

Thank you very much @probably-neb and @Misterio77 :beers: :smile:


on_ready doesnt start proc, yet the bot starts

Summary
pretty self explainatory, on_ready doesnt work
Reproduction Steps
I used discord.py but I needed to fetch members of a guild. Uninstalled discord.py as I saw the name is the same (import discord wouldnt work)
Code
client = commands.Bot(command_prefix = prefix)

@client.event
async def on_ready():
    os.system("cls")
    console.print(f"\n    Logged in as [green]{client.user.name}[/]\n")

@client.event
async def on_message(message):
    print("Hello")

loop = asyncio.get_event_loop()
loop.create_task(client.start(token))
loop.run_forever()

Expected Results
There should be an output in the console (the program is running in CMD) saying "Logged in as {name}" and a "Hello" every time I get a message in any server
Actual Results
Only the Hello prints
System Information

Python v3.10.2-final
discord.py-self v1.9.1-final
aiohttp v3.7.4.post0
system info: Windows 10 10.0.19043

Checklist

[X] I have searched the open issues for duplicates.
[X] I have shared the entire traceback.
[X] I am using a user token (and it isn't visible in the code).

Additional Information
token and prefix variables are specified ealier, no errors, no error handler.
console is from rich.console
note:
I tried specifying self_bot = True and user_bot = True, none work

On_ready is called only when the cache is populated, the bot may start receiving events before that, which is normal. Caching allows you to do guild.get_member, anything that has get in the name essentially. To disable caching, check out https://github.com/dolfies/discord.py-self/discussions/122
import discord
from discord.ext import commands

bot = commands.Bot(guild_subscription_options=discord.GuildSubscriptionOptions.off())

This will make on_ready considerably faster, but you'll have to do fetch_member, you'd essentially have to replace every get_ with fetch_.

i will try. Does that change anything with looping thru the guilds and getting the members? Also by any chance do you know how guild.subscribe() works? does it allow me to use for member in guild.members? It returns a bool and not a memberlist so Im wondering

Oops I realised that was just the prefix lol

Consider settings self_bot to True
bot = commands.Bot(self_bot=True)

This feature is broken on the rebase branch, so if you're going to use it, please wait for a bit or use version 1.x.x
If your issue has been resolved, please close this issue.

i will try. Does that change anything with looping thru the guilds and getting the members?

I would assume so, because with this option enabled, the bot doesn't store any data related to guilds in the cache. I'm not sure though, could you shed some more light on caching @dolfies?

All the Guild subscribing does is scrape members for small guilds. To loop through and get all members, do something like this:
for guild in client.guilds:
    await guild.subscribe()
    # do stuff with guild.members here

Yep thanks, that resolves the issue


little api additions

:tada: This PR is included in version 1.10.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


An application paper not on the list

Hi -- our paper "Realistic galaxy image simulation via score-based generative models" applies a diffusion model to galaxy simulation.
Here's the arxiv link:
https://arxiv.org/abs/2111.01713

Sorry for not adding your paper and thank you for letting me know. I just added it to repo !


Bug: iPhone mobile page viewing issue

Describe the bug
When viewing some pages on iphones (in any browser) the footer of the website is displaying too high up and obscuring the text. See screenshots below.
To Reproduce
Steps to reproduce the behavior:

On iphone open chrome or safari and go to flaviorbravo.com
Go to the "About Flavio" page from the menu
Scroll down

Can reproduce on Nik's phone
Screenshots

More Context
Bug submitted by Flavio Bravo - is hoping for a fix by next week as he has mailers going out that link to the website.
Your Environment
Include relevant details, so others can replicate the issue.

ios - most recent

Fixed!


Implement dropbox v2 api - v1 turns off on 28 June 2017

The v2 api does allow setting modification times - the client_modified attribute: See upload docs
It doesn't allow setting it on an existing object so it would require #348 fully useful.
On 28th June 2017 API v1 will be turned off
NB: dropbox now have an unofficial sdk for go
See also: #969

+1

@paulraines68 --update is the option you want. http://rclone.org/docs/#u-update

So --update does work with dropbox and uses the service_modified time?

@paulraines68

So --update does work with dropbox and uses the service_modified time?
Should do!

Would be nice to have it implemented.

@ncw can you please clarify the date when you are planning to integrate Dropbox v2 API into rclone? Would be helpful to know

Also, it'd be cool if rclone could support a resume mechanism based on Dropbox API v2 cursors at some point. This would dramatically speed up incremental syncs/copies from Dropbox.

+1

Dropbox v2 API has just hit master!
Please try this beta
https://beta.rclone.org/v1.36-144-g178ff62d/ (uploaded in 15-30 mins)

Bit of trouble building: beta now here: https://beta.rclone.org/v1.36-146-g71028e0f/

Hi,
I tested "rclone-v1.36-146-g71028e0fβ-linux-amd64.zip", and found that rclone copy take a long time (used to be very quick).

$ du -sh .
2.9G	.

$ rclone --version
rclone v1.36-146-g71028e0fβ

<< change a small text file >>

$ time rclone copy . rudybox:Public/drops

real	3m39.140s
user	0m35.944s
sys	0m5.420s

<< do it again, not changing anything >>

$ time rclone copy . rudybox:Public/drops

real    3m6.348s
user    0m37.836s
sys    0m3.120s

Please check. Thank you!  :)

@alpha-rudy which rclone are you comparing it with?

FYI, Dropbox extended the cutoff date of v1 to September 28, 2017.
https://blogs.dropbox.com/developers/2017/06/updated-api-v1-deprecation-timeline/

Hi @ncw, I compared it with rclone-v1.36-linux-amd64.
Thanks.  :)

Current beta
$ rclone -v sync /tmp/1000files dropbox:1000files
2017/06/27 10:04:57 INFO  : Dropbox root '1000files': Modify window is 1s
2017/06/27 10:05:05 INFO  : Dropbox root '1000files': Waiting for checks to finish
2017/06/27 10:05:05 INFO  : Dropbox root '1000files': Waiting for transfers to finish
2017/06/27 10:05:05 INFO  : Waiting for deletions to finish
2017/06/27 10:05:05 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:              1000
Transferred:            0
Elapsed time:        8.1s

v1.36
$ rclone-v1.36 -v sync /tmp/1000files TestDropboxOld:1000files
2017/06/27 10:05:52 INFO  : Dropbox root '1000files': Modify window not supported
2017/06/27 10:05:57 INFO  : Dropbox root '1000files': Waiting for checks to finish
2017/06/27 10:05:57 INFO  : Dropbox root '1000files': Waiting for transfers to finish
2017/06/27 10:05:57 INFO  : Waiting for deletions to finish
2017/06/27 10:05:57 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:              1000
Transferred:            0
Elapsed time:        5.1s

Now log the transactions
$ rclone -vv sync /tmp/1000files dropbox:1000files --dump-bodies --log-file dropbox.new
$ rclone-v1.36 -vv sync /tmp/1000files TestDropboxOld:1000files --dump-bodies --log-file dropbox.old
$ ls -l dropbox.new dropbox.old
-rw-r----- 1 ncw ncw 940172 Jun 27 10:06 dropbox.new
-rw-r----- 1 ncw ncw 943699 Jun 27 10:07 dropbox.old
$ wc -l dropbox.new
5516 dropbox.new
$ wc -l dropbox.old
5206 dropbox.old
$ grep -c 'HTTP REQUEST' dropbox.new dropbox.old
dropbox.new:103
dropbox.old:103
$

So there does appear to be a bit of a slow down with the v2 API from 5s to 8s in the test above.  However it uses the same number of HTTP transactions of about the same size which means it is very likely the v2 API just is slower.
Does that agree with your tests @alpha-rudy

@mchudoba thanks for the heads-up!

Hi @ncw,
Thanks for your reply.
I'm sorry. I tried to follow your test but I cannot use rclone-v1.36 now. I think I will have same result as yours.

$ rclone-v1.36 -v sync . rudybox:Public/tests
2017/07/01 15:26:47 INFO  : Dropbox root 'Public/tests': Modify window not supported
2017/07/01 15:26:47 ERROR : Attempt 1/3 failed with 1 errors and: Invalid OAuth2 token.
2017/07/01 15:26:47 ERROR : Attempt 2/3 failed with 1 errors and: Invalid OAuth2 token.
2017/07/01 15:26:48 ERROR : Attempt 3/3 failed with 1 errors and: Invalid OAuth2 token.
2017/07/01 15:26:48 Failed to sync: Invalid OAuth2 token.

There are 4000 files in the dropbox_crypt's test folder.
rclone copy d:\test "dropbox_crypt:test" -vv

2017/07/05 23:34:37 DEBUG : rclone: Version "v1.36-231-g575e779b" starting with parameters ["rclone" "copy" "d:\\test" "dropbox_crypt:test" "-vv"]
2017/07/05 23:34:38 INFO  : Encrypted drive 'dropbox_crypt:test': Modify window is 1s
2017/07/05 23:35:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      1m5.9s

2017/07/05 23:36:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      2m5.9s

2017/07/05 23:37:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      3m5.9s

2017/07/05 23:38:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      4m5.9s

2017/07/05 23:39:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      5m5.9s

2017/07/05 23:40:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      6m5.9s

2017/07/05 23:41:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      7m5.9s

2017/07/05 23:42:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      8m5.9s

2017/07/05 23:43:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:      9m5.8s

2017/07/05 23:44:38 INFO  :
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:     10m5.8s

@alpha-rudy wrote

I'm sorry. I tried to follow your test but I cannot use rclone-v1.36 now. I think I will have same result as yours.

You'll need to make a new remote say dbold with the old version of rclone
@qopencc can you compare that with v1.36 too?

@ncw
rclone-v1.36-137-ga2e3af05-windows-amd64 : There is not the situation.
rclone-v1.36-158-ga5cfdfd2-windows-amd64----rclone-v1.36-231-g575e779b-windows-amd64: There is the situation.

@qopencc what exactly is the problem?

@ncw
rclone-v1.36-158-ga5cfdfd2-windows-amd64 ~~ rclone-v1.36-231-g575e779b-windows-amd64:
There are 4000 files in the dropbox_crypt's test folder.
rclone's copy and rclone's ls do not work.
There are 1000 files in the dropbox_crypt's test folder.
rclone's copy and rclone's ls work.
rclone-v1.36-137-ga2e3af05-windows-amd64 :
There are 4000 files in the dropbox_crypt's test folder.
rclone's copy and rclone's ls work.
There are 1000 files in the dropbox_crypt's test folder.
rclone's copy and rclone's ls work.

@qopencc I've done several tests and been unable to replicate this.  One with 1000 files in a crypted directory and one with 2000 files in the same directory.
Can you attach a log file with -vv --dump-bodies please, eg
rclone ls d:\test "dropbox_crypt:test" -vv --dump-bodies

Does ls work in the underlying dropbox remote?
Which bits of rclone do work?  How about rclone lsd dropbox_crypt:?
Can you check your network connectivity to api.dropboxapi.com?
I note this has both IPv4 and IPv6 addresses - which are you using?

@ncw
rclone-v1.36-137-ga2e3af05-windows-amd64 :
There 3981 files in the same directory.
rclone's ls and lsd ,copy work in the directory.
rclone's ls and lsd ,copy work in other directory.
rclone-v1.36-158-ga5cfdfd2-windows-amd64 ~~ rclone-v1.36-231-g575e779b-windows-amd64:
There 3981 files in the same directory.
rclone's ls and lsd ,copy do not work in the directory.
rclone's ls and lsd ,copy work in other directory.
Can you attach a log file with -vv --dump-bodies please
https://drive.google.com/drive/folders/0Bz6Qqy38NFGNNEZyVjhhczVFVEk?usp=sharing
Does ls work in the underlying dropbox remote?
ls does not work in the underlying dropbox remote
2017/07/07 22:06:32 DEBUG : rclone: Version "v1.36-231-g575e779b" starting with parameters ["rclone" "ls" "office5678_db:(rclone_office5678_crypt_db)/esbldpslqhglbrmoumpr3ns12g/mbjh9d5icknf7q26e77sl47ptg/hb6g8mvkthf9gfi4adld8l6h6k/mbjh9d5icknf7q26e77sl47ptg/6n4lmm26dr5hqm6kque8vgaipc/32gomj1jiif66amgaumpjn1ba5g8en164irhhusu75qe6iepemo0" "-vv"]
2017/07/07 22:06:33 INFO  : Dropbox root '(rclone_office5678_crypt_db)/esbldpslqhglbrmoumpr3ns12g/mbjh9d5icknf7q26e77sl47ptg/hb6g8mvkthf9gfi4adld8l6h6k/mbjh9d5icknf7q26e77sl47ptg/6n4lmm26dr5hqm6kque8vgaipc/32gomj1jiif66amgaumpjn1ba5g8en164irhhusu75qe6iepemo0': Modify window is 1s
Which bits of rclone do work? How about rclone lsd dropbox_crypt:?
lsd does not work
2017/07/07 22:17:53 DEBUG : rclone: Version "v1.36-231-g575e779b" starting with parameters ["rclone" "lsd" "office5678_crypt_db:(Program Files)\(portable)\(porable)\(portable)\(desktop)\(notepad++_backup)" "-vv"]
2017/07/07 22:17:55 INFO  : Encrypted drive 'office5678_crypt_db:(Program Files)/(portable)/(porable)/(portable)/(desktop)/(notepad++_backup)': Modify window is 1s
Can you check your network connectivity to api.dropboxapi.com?
I chedked my network connectivity to api.dropboxapi.com.
I note this has both IPv4 and IPv6 addresses - which are you using?
IPv4

@qopencc I can see the problem with that log thanks - there is a problem with the directory paging...  Will post a beta when I've worked out how to fix it.

@qopencc - I found the bug please try this beta!
https://beta.rclone.org/v1.36-242-gc3dac2e3/ (uploaded in 15-30 mins)

@ncw
rclone-v1.36-242-gc3dac2e3β-linux-amd64.zip :
copy and ls ,lsd work.
There is not windows version in the v1.36-242-gc3dac2e3.

@qopencc thanks for testing.
I've fixed the windows build here
https://beta.rclone.org/v1.36-245-gda2e2544/ (uploaded in 15-30 mins)

@ncw
rclone-v1.36-245-gda2e2544-windows-amd64 :
copy and ls ,lsd work.
Thank you.

I'm going to mark this as closed now - if anyone finds any more problems please open a new issue.


Move DynamicData into Azure.Core.Dynamic namespace

Addresses https://github.com/Azure/azure-sdk-for-net/issues/35944

[x] Make DynamicDataOptions a class
[x] Move DynamicData and related types to Azure.Core.Dynamic namespace, keeping extension methods in the root

API change check
APIView has identified API level changes in this PR and created following API reviews.
Azure.Core


mgrpxy/podman: host file permissions

When installing Uyuni Proxy on a machine where umask is set to 0027, the uyuni-proxy-squid container will not start successfully.
Apr 24 16:02:14 sh-n-dlin-06 uyuni-proxy-squid[16508]:   File "/usr/bin/uyuni-configure.py", line 8, in <module>
Apr 24 16:02:14 sh-n-dlin-06 uyuni-proxy-squid[16508]:     with open("/etc/uyuni/config.yaml") as source:
Apr 24 16:02:14 sh-n-dlin-06 uyuni-proxy-squid[16508]: PermissionError: [Errno 13] Permission denied: '/etc/uyuni/config.yaml'

The container's directory /etc/uyuni is (bind-)mounted from the container host's /etc/uyuni/proxy directory.
Calling "mgrpxy install podman /path/to/configtarball" creates the directory tree /etc/uyuni/proxy and unpacks the content of the config tar ball to /etc/uyuni/proxy. During these operations, the (root) user's umask is applied.
On a system with some amount of hardening, the user's umask is typically set to exclude access for "others", i.e. 0027. Because of this, the directories (/etc/uyuni and /etc/uyuni/proxy) and the config files are created without any access for non-file-user, non-file-group processes. The directories and files are created with ownership set to user "root" and group "root".
Unlike the other containers (running as user root), the squid container is running as user "squid" - and therefore reports "access denied" when trying to read "/etc/uyuni/config.yaml" (mapping to /etc/uyuni/proxy/config.yaml on the container host).
Possible fix:
Since this is a pre-known limitation, the installer should make sure the proper access permissions are set for /etc/uyuni/proxy and /etc/uyuni/proxy/config.yaml, so that non-root containers can access any required file.

I was able to reproduce the problem:

run umask 027
mgrpxy install podman config.tar.gz

The problem does not happen if /etc/uyuni folder is already existing before installation. I'll work on it.

I made a PR that:

remove /etc/uyuni/proxy setting during uninstallation
check if the permission of /etc/uyuni/proxy/config.yaml are 755 : if they're not it prints an error:

Error: failed to extract proxy config from config.tar.gz file: /etc/uyuni/proxy/config.yaml has no read permissions for all users. Check your umask settings.

@jmozd let me know if it can be a good solution. Thanks!

Looking at the PR, I see you actually checked for read permissions, rather than "755" - that's a good thing! 755 would contain executable permissions, which isn't for yaml files...
From my POV, changing permissions of config.yaml to 644 (instead of bailing out) would have been more tolerant, but having the error at least points to the root cause.


chore(repo): migrate nx to latest version (13.9.5)

What it does
Update Nx to the latest version

Related Issue(s)

Fixes #

Hey @leosvelperez, can you take a look?

Yeah, I'll be updating the project to support Nx 14. I haven't merged this PR because there are issues with the deprecated @astrojs/parser in the current version that makes the plugin for the project graph not work correctly. I swapped it in a branch for the @astrojs/compiler but then there are some issues with it because it's distributed as ESM and the Nx CLI uses the https://www.npmjs.com/package/v8-compile-cache package which doesn't play well with ESM.
I'm trying to get that sorted out and when it's done, I'll close this PR in favor of another one adding support for Nx v14.

Actually, I went ahead and created the PR to update to the latest version of Nx (v14.1.1). I figured the issue with the project graph plugin is not depending on the Nx version upgrade. Better to have that update that solves a separate issue https://github.com/nxtensions/nxtensions/issues/46.
Closing this in favor of #47.
@SebasG22 thanks for the contribution and apologies for the delay!


Multi tiers

More of a question but I was thinking … again
I am wondering if I can have origin servers all synced via nats and cdn servers on outer rings , then Cloudflare as the most outer ring ?
this is sometimes called tiers.
nats can dive this due to the kv being pub sub .
so any server that is subscribed to a key space will essentially be told the source file changeg all the way out to the outer rings .
this is not caching at all because caching is a late bound pattern where if it’s not in the outer ring the outer ring will fetch it from an inner ring .
what it is is early bound caching . The origin data changes and then all outer rings are told . They can then do their normal let’s bind / cache miss logic and go get the data.
this is a way to manage the thundering herd problem. You can essentially keep the rings primed when you start up new servers .
maybe it has prospects .. just wanted to voice my idea ..

Hello @gedw99 sorry for this late response. As the storages are CDN agnostics this won't be added in this repository but can be a feature in the repository Souin.


Unexpected result after cropping

Thanks for the awesome library. I have tried to add it in my project and it works without errors. but the result is not exactly as i expected. this is happening not for all images. some times it gives correct result some times it gives cropped image outside the specified zones. as an eg see below
Below is what i am trying to crop

and this is the result I got.

o_0
this is very strange...
can you reproduce it using the sample app?

I'm facing the same problem. if i do big crop then it gives cropped image outside the specified zone and when i do small crop then it gives the perfect result. Kindly request any suitable solution for that.


Node not updating parent

Hello.  I made the following changes (fixes).

Added NUnit test runner for VS 2017
When a Node is added to another Node, the parent was not being updated.  It was still referencing document as a parent.  See unit test VerifyChildDivParent()
Due to this, when the added node was removed from the parent, the remove was not working.  See unit test ChildIsRemovedFromParent()

This kept causing me to scratch my head with a production issue as why the Remove() was not working.
A potential issue, is that the parent will always be the last parent not the first parent.  If you add a node to multiple other Nodes, it may cause unintended behavior.  Perhaps parent node should be a collection?  Perhaps a node need to be made immutable.. ie copy on add?

Hello @anish714 ,
Thank you for your contribution, I will try to review it during the weekend.
Best Regards,
Jonathan

Hello @anish714 ,
The v1.6.7 has been released which include this fix.
Thank a lot for your pull.

Help us to support this library: Donate


[DO NOT MERGE -  running seed job for #13461] [BEAM-9980] make job_PostCommit_Python*.groovy files to one

Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

Run Seed Job

Run Python 3.6 PostCommit

Run Python 3.7 PostCommit


dev docs updates and visibility

The dev docs README https://github.com/microsoft/PowerToys/tree/master/doc/devdocs is not mentioned in https://github.com/microsoft/PowerToys/blob/master/CONTRIBUTING.md
Building instructions are outdated https://github.com/microsoft/PowerToys/tree/master/doc/devdocs#building-the-installers

Can we close this since this doesn't affect release?

Can we close this since this doesn't affect release?


python-language-server packaging issues

I'm surprised we have multiple pylsp plugins packaged up, but I don't see a clear way to actually use them.
They all depend on python-lsp-server, which makes propagating them into a python-lsp-server environment an infinite recursion.
Paired with the necessary overrides to make use of optional dependencies, this makes for a horrible usability, that warrants some explanation and documentation - ideally by its maintainers.
How are all of you using and especially combining those packages?

python-lsp-black, pylsp-mypy @cpcloud
python-lsp-jsonrpc, python-lsp-server @fabaff
python-jsp-ruff @linsui

Crimes were committed while trying to come up with a way to use these together. What follows isn't a reasonable solution an enduser can come up with.
{ pkgs
, ...
}:

let
  python = pkgs.python3.override {
    packageOverrides = self: super: {
      python-lsp-server = super.python-lsp-server.overridePythonAttrs (oldAttrs: {
        propagatedBuildInputs = oldAttrs.propagatedBuildInputs or [] ++ [
          self.python-lsp-black
          self.python-lsp-ruff
        ]
        # completions & renaming
        ++ oldAttrs.passthru.optional-dependencies.rope
        # complexity
        ++ oldAttrs.passthru.optional-dependencies.mccabe;
      });

      python-lsp-black = super.python-lsp-black.overridePythonAttrs (oldAttrs: {
        postPatch = oldAttrs.postPatch or '''' + ''
          substituteInPlace setup.cfg \
            --replace "python-lsp-server>=1.4.0;" ""
        '';

        propagatedBuildInputs = with super; [
          black
          toml
        ];

        doCheck = false;
      });

      python-lsp-ruff = super.python-lsp-ruff.overridePythonAttrs (oldAttrs: {
        postPatch = oldAttrs.postPatch or '''' + ''
          sed -i '/python-lsp-server/d' pyproject.toml
        '';

        nativeBuildInputs = with super; [
          setuptools
        ];

        propagatedBuildInputs = with super; [
          lsprotocol
          tomli
        ];

        doCheck = false;
      });
    };
  };
in
  environment.systemPackages = [ python.pkgs.python-lsp-server ];

I just use
    (python3.withPackages (p: (with p; [
      python-lsp-server
      python-lsp-ruff
    ])))

and it just works so I'm not aware the problem. Is that a problem when multiple plugins are used?

python-lsp-jsonrpc is not a plugin/extension/addon per se but I guess that it would be treated like one. Not sure, if pylsb would work without it, though.
For a nice user experience it would preferably to follow the way we do it with pytest or flake8 if that make sense.

Tangential question: has anyone managed to get nvim-lspconfig + python3Packages.ruff-lsp to work? I'm trying signatureHelp and keeps saying it's not supported

Tangential question: has anyone managed to get nvim-lspconfig + python3Packages.ruff-lsp to work? I'm trying signatureHelp and it keeps saying it's not supported

I remember making it work yes. However, I know use the ruff plugin of python-lsp-server.
More generally, here is what we have implemented in nixvim to get around this plugin problem.

Just mentioning this if anyone is interested in a workaround for a standalone package.
Following nixvim's approach, I also got it working with home-manager (flake setup) and a custom package:
# ./packages/python-lsp-server/default.nix
{
  pylsp-mypy,
  pylsp-rope,
  python-lsp-server,
}:
with builtins; let
  removeInput = inputs: filter (pkg: pkg.pname != "python-lsp-server") (inputs or []);

  patchSetupCfg = postPatch:
    (postPatch or "")
    + ''
      sed -i '/python-lsp-server/d' setup.cfg
    '';

  pylsp-mypy' = pylsp-mypy.overridePythonAttrs (oldAttrs: {
    doCheck = false;
    propagatedBuildInputs = removeInput oldAttrs.propagatedBuildInputs;
    postPatch = patchSetupCfg oldAttrs.postPatch;
  });

  pylsp-rope' = pylsp-rope.overridePythonAttrs (oldAttrs: {
    doCheck = false;
    propagatedBuildInputs = removeInput oldAttrs.propagatedBuildInputs;
    postPatch = patchSetupCfg oldAttrs.postPatch;
  });

  thirdPartyPlugins = [pylsp-mypy' pylsp-rope'];
in
  python-lsp-server.overridePythonAttrs (oldAttrs: {
    propagatedBuildInputs =
      (oldAttrs.propagatedBuildInputs or [])
      ++ python-lsp-server.optional-dependencies.rope
      ++ thirdPartyPlugins;

    disabledTests =
      (oldAttrs.disabledTests or [])
      ++ [
        "test_notebook_document__did_open"
        "test_notebook_document__did_change"
      ];
  })

# flake.nix
{
  # ...
  modules = [./home.nix];
  # ...
}

# home.nix
{
  # ...
  home = {
    # ...
    packages = [
      (pkgs.python3Packages.callPackage ./packages/python-lsp-server {})
      # ...
    ];
    # ...
  },
  # ...
}

Is seems like use cases where additional packages add functionality to python-lsp-server, such as ruff / black / etc, should be handled in its packing code as optional flags. Then users could easily .override as needed.

That gets me a python interpreter with these two libraries in the PYTHONPATH and coincidentally pylsp in the PATH.
But it also installs python into my environment and pollutes the python instance with those libraries.
I kinda want our pylsp package to be an extensible, but otherwise self-contained application.

Seconding this, especially in the specific case of Python development. My editor only had access to the lsp-specific python instance, so it didn't think any of my module imports were valid, which was a very confusing bug to track down.
With the old system that was removed in this commit, it seemed far more trivial to create something that's both self-contained and usable. I don't think we should revert back to this system for numerous reasons, but at least it provided a clear access point to the user.


Make swift-syntax (mostly) build in Swift 6 mode

This almost makes swift-syntax build in Swift 6 mode. The only change holding us back is that CommandLine.arguments is a static variable and accessing it in Swift 6 mode raises an error (rdar://113799564).

@swift-ci Please test

@swift-ci Please test

@swift-ci Please test

@swift-ci Please test Windows


The topology and DCD trajectory files don't have the same number of atoms

Dear Sir
I am trying TTMD calculation with default config_rt.dat files provided by you. I am getting following errors, please help me to solve this problem
Traceback (most recent call last):
File "/mnt/d/TTMD-2.0/package/ttmd.py", line 150, in
RUN_class.run(VARS)
File "/mnt/d/TTMD-2.0/package/ttmd.py", line 55, in run
self.serial(vars)
File "/mnt/d/TTMD-2.0/package/ttmd.py", line 65, in serial
replica_run(i, self.device, vars)
File "/mnt/d/TTMD-2.0/package/ttmd.py", line 114, in replica_run
REPLICA_class.simulation()
File "/mnt/d/TTMD-2.0/package/replica.py", line 52, in simulation
simulation.run()
File "/mnt/d/TTMD-2.0/package/simulation/run.py", line 38, in run
avg = self.score_simulation(trj, i, set)
File "/mnt/d/TTMD-2.0/package/simulation/run.py", line 174, in score_simulation
outscore = self.score(self.complprmtop, wrap_trj, temp)
File "/mnt/d/TTMD-2.0/package/scoring_function/rt.py", line 52, in score
u = mda.Universe(topology, trajectory)
File "/home/drsaravanan/miniconda3/envs/ttmd2/lib/python3.10/site-packages/MDAnalysis/core/universe.py", line 365, in init
self.load_new(coordinates, format=format, in_memory=in_memory,
File "/home/drsaravanan/miniconda3/envs/ttmd2/lib/python3.10/site-packages/MDAnalysis/core/universe.py", line 569, in load_new
raise ValueError("The topology and {form} trajectory files don't"
ValueError: The topology and DCD trajectory files don't have the same number of atoms!
Topology number of atoms 6116
Trajectory: run_300.dcd Number of atoms 76588
error.txt
Please check error.txt file

Dear Saranthee,
this issue is generated by a bug in the code.
It should be easily overcome by setting "dryer = yes" in the config file.
We are grateful for your patience and perseverance in using ttmd and we apologize for the inconvenience.
Kind regards,
Silvia

Dear Molecularmodelingsection/Ttmd,
The command "dryer=yes" is already available in the config file. In the
RUN_1/MD/ path, I got run_300, dry_300, and swag_300 files already. It is
taking automatically wrong prmtop file. It should take solv. prmtop and
run_300.dcd or dry_complex.prmtop with dry_300.dcd.
I have tried for three different complexes it is not working
also, I removed ttmd and reinstall ttmd it is not working
I kindly request you please help me to solve this problem
If you ready to check the files i will send you or i will give access to my
computer to check. Please help to solve this
On Tue, Apr 9, 2024 at 3:01 PM silviett @.***> wrote:

Dear Saranthee,
this issue is generated by a bug in the code.
It should be easily overcome by setting "dryer = yes" in the config file.
We are grateful for your patience and perseverance in using ttmd and we
apologize for the inconvenience.
Kind regards,
Silvia
—
Reply to this email directly, view it on GitHub
https://github.com/molecularmodelingsection/TTMD/issues/12#issuecomment-2045129851,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BFTFUOY4YVYMRC4W4OWJFULY4PRCFAVCNFSM6AAAAABFWZY2WWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGEZDSOBVGE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Dear TTMD group,
I am eagerly anticipating your response.
Kindly inform me if you are prepared to engage in collaborative research
work.
I possess a collection of complexes and require TTMD results.
Please inform me at your earliest convenience.
On Tue, Apr 9, 2024 at 3:39 PM Saravanan Kandasamy @.***>
wrote:

Dear Molecularmodelingsection/Ttmd,
The command "dryer=yes" is already available in the config file. In the
RUN_1/MD/ path, I got run_300, dry_300, and swag_300 files already. It is
taking automatically wrong prmtop file. It should take solv. prmtop and
run_300.dcd or dry_complex.prmtop with dry_300.dcd.
I have tried for three different complexes it is not working
also, I removed ttmd and reinstall ttmd it is not working
I kindly request you please help me to solve this problem
If you ready to check the files i will send you or i will give access to
my computer to check. Please help to solve this
On Tue, Apr 9, 2024 at 3:01 PM silviett @.***> wrote:

Dear Saranthee,
this issue is generated by a bug in the code.
It should be easily overcome by setting "dryer = yes" in the config file.
We are grateful for your patience and perseverance in using ttmd and we
apologize for the inconvenience.
Kind regards,
Silvia
—
Reply to this email directly, view it on GitHub
https://github.com/molecularmodelingsection/TTMD/issues/12#issuecomment-2045129851,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BFTFUOY4YVYMRC4W4OWJFULY4PRCFAVCNFSM6AAAAABFWZY2WWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGEZDSOBVGE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Dear TTMD group, I am eagerly anticipating your response. Kindly inform me if you are prepared to engage in collaborative research work. I possess a collection of complexes and require TTMD results. Please inform me at your earliest convenience. On Tue, Apr 9, 2024 at 3:39 PM Saravanan Kandasamy @.> wrote:
…
Dear Molecularmodelingsection/Ttmd, The command "dryer=yes" is already available in the config file. In the RUN_1/MD/ path, I got run_300, dry_300, and swag_300 files already. It is taking automatically wrong prmtop file. It should take solv. prmtop and run_300.dcd or dry_complex.prmtop with dry_300.dcd. I have tried for three different complexes it is not working also, I removed ttmd and reinstall ttmd it is not working I kindly request you please help me to solve this problem If you ready to check the files i will send you or i will give access to my computer to check. Please help to solve this On Tue, Apr 9, 2024 at 3:01 PM silviett @.> wrote: > Dear Saranthee, > this issue is generated by a bug in the code. > It should be easily overcome by setting "dryer = yes" in the config file. > We are grateful for your patience and perseverance in using ttmd and we > apologize for the inconvenience. > Kind regards, > Silvia > > — > Reply to this email directly, view it on GitHub > <#12 (comment)>, > or unsubscribe > https://github.com/notifications/unsubscribe-auth/BFTFUOY4YVYMRC4W4OWJFULY4PRCFAVCNFSM6AAAAABFWZY2WWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBVGEZDSOBVGE > . > You are receiving this because you authored the thread.Message ID: > @.***> >

cd TTMD/package/simulation/
vi run.py and locate  line 38
Replace trj with traj. (I think it should look like "avg = self.score_simulation(traj, i, set)")


Can a service_account.Credentials instance be created from application default credentials instead of JSON file?

I need to be able to call the GMail API, which I can do locally on my laptop
credentials = service_account.Credentials.from_service_account_file(
                SERVICE_ACCOUNT_FILE, scopes=SCOPES)
delegated_credentials = credentials.with_subject(MAILBOX)
service = build('gmail', 'v1', credentials=delegated_credentials)

But I don't want to store the JSON key file when using Cloud Run. Is it possible to use the default credentials somehow? My Cloud Run instance is running as a service account with domain-wide delegation
def_creds, __ = google.auth.default(
            scopes=SCOPES
        )
auth_req = google.auth.transport.requests.Request()
def_creds.refresh(auth_req)

How can I use the def_creds to create a service_account.Credentials instance using the current service account?

Hi @Rossco8,
Thanks for opening a question. The default service account in the Cloud Run environment will be detected as google.auth.compute_engine.Credentials and there is no easy way to convert that to a service account.
Normally this does not matter, as the service account or compute engine credential will both have a valid token and are interchangeable for requests.
However, in your case it looks like you need to modify (1) the scopes and (2) the email to successfully do domain-wide delegation per https://developers.google.com/identity/protocols/oauth2/service-account#delegatingauthority. The scopes are modifiable through the scopes kwarg, but I don't see a way to modify the subject.
Impersonated credentials might work here, but I haven't tried it myself.
@arithmetic1728 Do you know of a clean way to do this?
I found some similar questions but some are a bit old and I did not see a clear consensus on the best approach:

https://stackoverflow.com/questions/59601045/gcp-cloud-function-domain-wide-delegation-using-application-default-credential
https://stackoverflow.com/questions/53202767/gae-attributeerror-credentials-object-has-no-attribute-with-subject/57092533#57092533
https://stackoverflow.com/questions/64658391/how-can-i-grant-a-cloud-run-service-access-to-service-accounts-credentials-with

Thanks for the info. I had a look at the impersonated credentials API and it doesn't appear to offer a way to create an instance of type google.auth.service_account.Credentials which (I think) is what I need

I don't know other ways to do so. We can use user credentials to impersonate service account credentials, but I don't know if it will work with domain wide delegation (because no where to specify the sub claim as Bu Sun mentioned). Impersonation doesn't create a service account credentials, it works the following way:
(1) configure the user/service account credentials for impersonation
(2) create a token using the user credential
(3) call impersonation API with the token to exchange a new token
(4) this new token can be used as if it is generated by the service account
All details can be found here: https://cloud.google.com/iam/docs/creating-short-lived-service-account-credentials#requesting_short-lived_credentials
The following is a curl example from the reference (here gcloud auth application-default print-access-token prints out the user credential token)
curl -X POST \
-H "Authorization: Bearer "$(gcloud auth application-default print-access-token) \
-H "Content-Type: application/json; charset=utf-8" \
-d @request.json \
"https://iamcredentials.googleapis.com/v1/projects/-/serviceAccounts/SA_NAME@PROJECT_ID.iam.gserviceaccount.com:generateAccessToken"

Thanks. I've been able to avoid storing service account key files anywhere until this requirement came up. This will be the exception I suppose.
Happy to close this issue


podsecuritypolicy/rbac: update instruction

Overhaul of the instruction that includes:

remove ALLOW_ANY_TOKEN=true that doesn't exist
remove ENABLE_RBAC=true that doesn't exist (and enabled by default)
remove RUNTIME_CONFIG="extensions/v1beta1=true,extensions/v1beta1/podsecuritypolicy=true" as it's enabled by default
mention that local-up-cluster.sh creates PSP policies, roles, and binding by default
fix names of the roles, policies, and bindings
mention about the latest changes that affects PSPs ordering

Fixes https://github.com/kubernetes/examples/issues/37
PTAL @liggitt @pweil- @tallclair
CC @simo5

@ahmetb PTAL.

@ericchiang does this LGTY?

There are still a lot of references to the "any token" authenticator:
$ kubectl --server=https://<IP_ADDRESS>:6443 --token=foo/privileged-psp-users create -f staging/podsecuritypolicy/rbac/pod.yaml

Since I was the one to remove the authenticator, I'm happy to switch this over to impersonation myself in another PR. The cleanups in this PR are good, but I don't think it fully makes this work on a generic localup cluster yet.

There are still a lot of references to the "any token" authenticator:

Yes; I don't know when I'll be able to update this PR, so I'd like to merge it as-is.

If it's safe to merge, I can merge today.

If it's safe to merge, I can merge today.

What would be great 👍

Done, please follow up with another PR soon.


CSGCombiner - CSG Geometry disappearing

Godot version:
Master
OS/device including version:
Window 7
NVidia 680
Issue description:
When having a CSGContainer as a child of another CSGContainer, and the child CSGContainer has shapes in it. If you repaernt that child CSGContainer to a none csg node outside of the parent CSGContainer all the geometry seems to be gone and it is also not drawn.
Steps to reproduce:
-Create a Spatial node with a CSGContainer as a child node.
-Now create a CSGContainer as a child of the first CSGContainer.
-Add whatever geometry you like as child of that second CSGContainer.
--Reparent the second CSGContainer to remove it from the first CSGContainer and make it a child of the Spatial. ***ALl the displayed geometry of the reparented CSGContainer should now desapear.
Minimal reproduction project:
CSGBug.zip

Can confirm in Godot 3.2 alpha3
Issue description:
CSG objects when they are children of a CSG Combiner Node disappear completely and become unclickable in the viewport when the parent Combiner is put into another CSG Combiner and the Ctrl+Z to Undo or get reparented
Steps to reproduce:

Add CSG Combiner
Add CSG Objects as children
Add another CSG Combiner
In the Scene Panel, drag and drop the former CSG Combiner node with it's children into the newly created one
Press Ctrl+Z or reparent the Node by dragging it elsewhere


Supports for swift4 or not ?

Supports for swift4 or not ?  I would like to know whether it is work for swift4 or not

It supports Swift 4, you just need to fix some issues concerning how Swift 4 handles selectors.
You are going to add "@objc" whenever needed but before, Xcode can mess up some if you fix them automatically.

@Azathoth79 Thanks


dask.distributed should have a function like IPython.parallel's "apply"

I need this so I can tell the workers to download some files they will need locally. There are probably other times we will need this to setup something on the workers.

Yes, that might make sense.  Alternatively if we were to end up tying ourselves to something like ipython parallel (which we probably wouldn't do) then we could always rely on ipython parallel to do this work for us.

If you are already relying on dill/cloudpickle, a simple version of this should be pretty straightforward, especially if you can guarantee that the arguments are small (e.g. paths or URLs rather than arrays). In those cases, you can build simple messages with content = pickle.dumps(dict(f=f, args=args, kwargs=kwargs))
Almost all of IPython's complexity comes from the async implementation. If you can manage to assert any of:

wait for reply
ignore reply
request results explicitly, rather than expect them to be pushed back to you

It gets a lot simpler

For instance, here's a simple demo of apply over zmq, which blocks on the results. To ignore results, simply remove the reply.

I'm not too worried about implementing such an operation (there are enough operations things as-or-more-complex in the client/scheduler/worker system.)  I'm more concerned about whether or not we want to get in the business of "do this there now please" style execution.  Mostly I think that this comes down to practical use cases.
If the use case is "tell a worker to download a file that it will need for a computation" then I would suggest that should probably be a task in a task graph, and not something that we procedurally tell the workers to do.  I would rather focus on making it easy to encode "download these files" task and incorporate them directly into the graph, hence #241 #242 .
@cowlicks are you running into use cases where a solution of one of those two issues wouldn't suffice?

@mrocklin no. I think that those methods are the right way to go. It should be easy to have from_s3 with globbing too.


Support for AVIF?

It looks like AVIF is not supported though it appears that it is by sharp. From the sharp site...

The typical use case for this high speed Node.js module is to convert large images in common formats to smaller, web-friendly JPEG, PNG, AVIF and WebP images of varying dimensions.

But in the console i get the following...

Expected one of: heic, heif, jpeg, jpg, png, raw, tiff, webp for format but received unsupported of type string

Is there a plan to add support for this?

Is this just a matter of updating to the most recent version of sharp v0.28.3?

Updating sharp is a necessary step since support for AVIF was added in version 0.27. I don't know if work is needed beyond that.


Add example to align sticky header and body

Add an example on creating a third party component HorizontalScrollBar to fix #282 and #259
Since it's third party component, it has no impact on existing reactabular code.

Codecov Report

Merging #312 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #312   +/-   ##
=======================================
  Coverage   53.87%   53.87%
=======================================
  Files          21       21
  Lines         464      464
  Branches      102      102
=======================================
  Hits          250      250
+ Misses        186      185    -1
- Partials       28       29    +1

Impacted Files
Coverage Δ

...ages/reactabular-virtualized/src/calculate-rows.js
17.14% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c9ce31f...7c6dcdb. Read the comment docs.


0.30.1-b1

Current coverage is 49.19%

Merging #1338 into develop will decrease coverage by -0.01% as of 29d1f1c

@@            develop   #1338   diff @@
=======================================
  Files           958     959     +1
  Stmts         65608   65673    +65
  Branches          0       0
  Methods           0       0
=======================================
+ Hit           32282   32305    +23
  Partial           0       0
- Missed        33326   33368    +42

Review entire Coverage Diff as of 29d1f1c

Powered by Codecov. Updated on successful CI builds.

:+1:


Usage

I dont understand. How can I refer to this tools in my project? 🫢 Is this .jar file? This is mainly my own understand problem, but...

Building android-app with command line on devices


Split out lower-dimensional objects

split out projection, slice, and onedspectrum into their own module. We'll
probably want to import these from somewhere else in the long term anyway

Coverage decreased (-0.21%) to 67.18% when pulling cd61adf58a583e9802bbcfd0e429846bdd19083e on keflavich:split_lower_dim_structures into d2c0420a1235d9ae1d50e2f6e1dc8038cf38aa24 on radio-astro-tools:master.

The "red" is just coveralls being a doofus.  There was no change in real coverage.

btw you can now configure coveralls to have a threshold for a build to fail (e.g. -0.01%)

well, in this case, it's just wrong (afaict) - I didn't add or remove any lines of code.... though maybe the import statements count?


URL of the API missing in the overview page of the dev portal

Describe your problem(s)
URL of the API missing in the overview page of the dev portal. This is a crucial information and is not available in 3.1.0 Alpha release
Describe your solution
Refer above
How will you implement it

URL is displayed in the Available Environments section

This should not be a drop down but should be visible directly. Besides available environment is not the correct label to display the gateway URLs.

Its a small UI fix but can have a bigger impact on the UX.

Hi @nadeesha5814 ,
The problem here is , We can't show single URL as API URL here, because there can be multiple Gateway environments, In that case, We couldn't pick a random one.
And also what do you mean by URL of the API ? here, is it Gateway URL + the API context ?

Hi Kasun,
What I mean is Gateway URL+API Context, this is similar to the
experience that was there in API M 2.x family of products.
Nadeesha
2020 පෙබ 11, අඟහ දින 16.20 ට දින Kasun Thennakoon<EMAIL_ADDRESS>මෙසේ ලිව්වේය:

Hi @nadeesha5814 https://github.com/nadeesha5814 ,
The problem here is , We can't show single URL as API URL here, because
there can be multiple Gateway environments, In that case, We couldn't pick
a random one.
And also what do you mean by URL of the API ? here, is it Gateway URL +
the API context ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/wso2/product-apim/issues/7385?email_source=notifications&email_token=ABJLH6YOBNLCTE7HVAKJFGLRCJ7IHA5CNFSM4KQENI62YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELL7BJI#issuecomment-584577189,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABJLH67WJMFAVEC2UMBCPZTRCJ7IHANCNFSM4KQENI6Q
.

--
Nadeesha


[Acceptable breaking change] Reform the To*Attachment traits

circle-ci fails to download the dependencies, ignoring it.


https://dexie.org/docs/ not works

This url https://dexie.org/docs is not part of the offline

That used to be an issue but unfortunately the old version that has the issue might be installed in your service worker. Can you try uninstalling the service worker or click the 'available offline' switch to remove it?


Can this work client-side?

Is this intended to be able to work client side with components such as react-markdown?
https://github.com/remarkjs/react-markdown
I'm trying to use it in a preview component for a blog writing component.
I'm getting this module dependency error, although, again, I'm not sure if it's intended to work as I'm expecting.
Module not found: Can't resolve 'dns'

Oh, interesting. I hadn't thought about supporting the client side. I think what we need to do is dynamically import the make-fetch-happen and the url module if fetch/URL aren't already defined. Would you be willing to make that work?

Has there been any progress on this?

Nobody's working on it


Blueprint for OpenFlow multi-table pipeline processing

OpenFlow Multi-table pipeline processing (adjustments on mef-eline, of-lldp, coloring. INT needs this feature.

mef_eline which table should it write it to?
of_lldp which table should it write it to?
coloring which table should it write it to?
it was also discussed an idea of a potential napp to push and install flows to one table to other ones, needs to discuss if needed and the benefits

If table if different than 0, then it's also desirable how to enable that how flows from table 0 to another table.

Moving this discussion to here

Landed on https://github.com/kytos-ng/kytos/pull/359


Permissive License

Is it possible to switch Eris product range to a more permissive license like ASL 2.0?

duplicate of #148; eris-db will remain GPL3 for the foreseeable future. Please see this post for our rationale.

@sirinath you'll be glad to hear we've relicensed to Apache 2:
https://github.com/eris-ltd/eris-db/blob/master/license.md


Unable to create restic repo on exfat file system

Output of restic version
restic 0.9.4 compiled with go1.11.4 on linux/amd64
How did you run restic exactly?
restic init --repo /media/usb2disk/restic-backups
Fatal: create key in repository at /media/usb2disk/restic-backups failed: chmod /media/usb2disk/restic-backups/keys/xxxxxxx129a57e88671f14799366326da40305693822a32de797a2591078e984: operation not permitted
What backend/server/service did you use to store the repository?
local file on exfat filesystem:
lsblk -f | grep usb2disk
└─sdb1                exfat             6A4F-0A7F                              /media/usb2disk
Expected behavior
Repository to be created without issues.
Actual behavior
Repository partially created, but not usable.
Steps to reproduce the behavior
Create repo on exfat filesystem.
Do you have any idea what may have caused this?
exfat filesystem, I suspect, as it doesn't support chmod.
Do you have an idea how to solve the issue?
No.
Did restic help you or made you happy in any way?
Using restic already with local repo (on ext4), and also backblaze b2. It's great!

Thanks for the report! I consider this a bug, it should try to run chmod, but if it fails it should not abort. Maybe (if we can find a good way) it could print the error.

Hi,
With the latest release it seems to work now.
I do not get the error when I try to initialize a repo on exfat file system.
restic version
restic 0.9.6 compiled with go1.13.4 on linux/amd64