[Question] How to load wikipedia ? Beam runner ?

When nlp.load_dataset('wikipedia'), I got

WARNING:nlp.builder:Trying to generate a dataset using Apache Beam, yet no Beam Runner or PipelineOptions() has been provided. Please pass a nlp.DownloadConfig(beam_runner=...) object to the builder.download_and_prepare(download_config=...) method. Default values will be used.
AttributeError: 'NoneType' object has no attribute 'size'

Could somebody tell me what should I do ?
Env
On Colab,
git clone https://github.com/huggingface/nlp
cd nlp
pip install -q .

%pip install -q apache_beam mwparserfromhell
-> ERROR: pydrive 1.3.1 has requirement oauth2client>=4.0.0, but you'll have oauth2client 3.0.0 which is incompatible.
ERROR: google-api-python-client 1.7.12 has requirement httplib2<1dev,>=0.17.0, but you'll have httplib2 0.12.0 which is incompatible.
ERROR: chainer 6.5.0 has requirement typing-extensions<=3.6.6, but you'll have typing-extensions <IP_ADDRESS> which is incompatible.

pip install -q apache-beam[interactive]
ERROR: google-colab 1.0.0 has requirement ipython~=5.5.0, but you'll have ipython 5.10.0 which is incompatible.

The whole message
WARNING:nlp.builder:Trying to generate a dataset using Apache Beam, yet no Beam Runner or PipelineOptions() has been provided. Please pass a nlp.DownloadConfig(beam_runner=...) object to the builder.download_and_prepare(download_config=...) method. Default values will be used.

Downloading and preparing dataset wikipedia/20200501.aa (download: Unknown size, generated: Unknown size, total: Unknown size) to /root/.cache/huggingface/datasets/wikipedia/20200501.aa/1.0.0...

---------------------------------------------------------------------------

AttributeError                            Traceback (most recent call last)

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.DoFnRunner.process()

44 frames

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.PerWindowInvoker.invoke_process()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window()

/usr/local/lib/python3.6/dist-packages/apache_beam/io/iobase.py in process(self, element, init_result)
   1081       writer.write(e)
-> 1082     return [window.TimestampedValue(writer.close(), timestamp.MAX_TIMESTAMP)]
   1083

/usr/local/lib/python3.6/dist-packages/apache_beam/io/filebasedsink.py in close(self)
    422   def close(self):
--> 423     self.sink.close(self.temp_handle)
    424     return self.temp_shard_path

/usr/local/lib/python3.6/dist-packages/apache_beam/io/parquetio.py in close(self, writer)
    537     if len(self._buffer[0]) > 0:
--> 538       self._flush_buffer()
    539     if self._record_batches_byte_size > 0:

/usr/local/lib/python3.6/dist-packages/apache_beam/io/parquetio.py in _flush_buffer(self)
    569       for b in x.buffers():
--> 570         size = size + b.size
    571     self._record_batches_byte_size = self._record_batches_byte_size + size

AttributeError: 'NoneType' object has no attribute 'size'

During handling of the above exception, another exception occurred:

AttributeError                            Traceback (most recent call last)

<ipython-input-9-340aabccefff> in <module>()
----> 1 dset = nlp.load_dataset('wikipedia')

/usr/local/lib/python3.6/dist-packages/nlp/load.py in load_dataset(path, name, version, data_dir, data_files, split, cache_dir, download_config, download_mode, ignore_verifications, save_infos, **config_kwargs)
    518         download_mode=download_mode,
    519         ignore_verifications=ignore_verifications,
--> 520         save_infos=save_infos,
    521     )
    522

/usr/local/lib/python3.6/dist-packages/nlp/builder.py in download_and_prepare(self, download_config, download_mode, ignore_verifications, save_infos, dl_manager, **download_and_prepare_kwargs)
    370                 verify_infos = not save_infos and not ignore_verifications
    371                 self._download_and_prepare(
--> 372                     dl_manager=dl_manager, verify_infos=verify_infos, **download_and_prepare_kwargs
    373                 )
    374                 # Sync info

/usr/local/lib/python3.6/dist-packages/nlp/builder.py in _download_and_prepare(self, dl_manager, verify_infos)
    770         with beam.Pipeline(runner=beam_runner, options=beam_options,) as pipeline:
    771             super(BeamBasedBuilder, self)._download_and_prepare(
--> 772                 dl_manager, pipeline=pipeline, verify_infos=False
    773             )  # TODO{beam} verify infos
    774

/usr/local/lib/python3.6/dist-packages/apache_beam/pipeline.py in __exit__(self, exc_type, exc_val, exc_tb)
    501   def __exit__(self, exc_type, exc_val, exc_tb):
    502     if not exc_type:
--> 503       self.run().wait_until_finish()
    504
    505   def visit(self, visitor):

/usr/local/lib/python3.6/dist-packages/apache_beam/pipeline.py in run(self, test_runner_api)
    481       return Pipeline.from_runner_api(
    482           self.to_runner_api(use_fake_coders=True), self.runner,
--> 483           self._options).run(False)
    484
    485     if self._options.view_as(TypeOptions).runtime_type_check:

/usr/local/lib/python3.6/dist-packages/apache_beam/pipeline.py in run(self, test_runner_api)
    494       finally:
    495         shutil.rmtree(tmpdir)
--> 496     return self.runner.run_pipeline(self, self._options)
    497
    498   def __enter__(self):

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/direct/direct_runner.py in run_pipeline(self, pipeline, options)
    128       runner = BundleBasedDirectRunner()
    129
--> 130     return runner.run_pipeline(pipeline, options)
    131
    132

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in run_pipeline(self, pipeline, options)
    553
    554     self._latest_run_result = self.run_via_runner_api(
--> 555         pipeline.to_runner_api(default_environment=self._default_environment))
    556     return self._latest_run_result
    557

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in run_via_runner_api(self, pipeline_proto)
    563     # TODO(pabloem, BEAM-7514): Create a watermark manager (that has access to
    564     #   the teststream (if any), and all the stages).
--> 565     return self.run_stages(stage_context, stages)
    566
    567   @contextlib.contextmanager

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in run_stages(self, stage_context, stages)
    704               stage,
    705               pcoll_buffers,
--> 706               stage_context.safe_coders)
    707           metrics_by_stage[stage.name] = stage_results.process_bundle.metrics
    708           monitoring_infos_by_stage[stage.name] = (

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in _run_stage(self, worker_handler_factory, pipeline_components, stage, pcoll_buffers, safe_coders)
   1071         cache_token_generator=cache_token_generator)
   1072
-> 1073     result, splits = bundle_manager.process_bundle(data_input, data_output)
   1074
   1075     def input_for(transform_id, input_id):

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in process_bundle(self, inputs, expected_outputs)
   2332
   2333     with UnboundedThreadPoolExecutor() as executor:
-> 2334       for result, split_result in executor.map(execute, part_inputs):
   2335
   2336         split_result_list += split_result

/usr/lib/python3.6/concurrent/futures/_base.py in result_iterator()
    584                     # Careful not to keep a reference to the popped future
    585                     if timeout is None:
--> 586                         yield fs.pop().result()
    587                     else:
    588                         yield fs.pop().result(end_time - time.monotonic())

/usr/lib/python3.6/concurrent/futures/_base.py in result(self, timeout)
    430                 raise CancelledError()
    431             elif self._state == FINISHED:
--> 432                 return self.__get_result()
    433             else:
    434                 raise TimeoutError()

/usr/lib/python3.6/concurrent/futures/_base.py in __get_result(self)
    382     def __get_result(self):
    383         if self._exception:
--> 384             raise self._exception
    385         else:
    386             return self._result

/usr/local/lib/python3.6/dist-packages/apache_beam/utils/thread_pool_executor.py in run(self)
     42       # If the future wasn't cancelled, then attempt to execute it.
     43       try:
---> 44         self._future.set_result(self._fn(*self._fn_args, **self._fn_kwargs))
     45       except BaseException as exc:
     46         # Even though Python 2 futures library has #set_exection(),

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in execute(part_map)
   2329           self._registered,
   2330           cache_token_generator=self._cache_token_generator)
-> 2331       return bundle_manager.process_bundle(part_map, expected_outputs)
   2332
   2333     with UnboundedThreadPoolExecutor() as executor:

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in process_bundle(self, inputs, expected_outputs)
   2243             process_bundle_descriptor_id=self._bundle_descriptor.id,
   2244             cache_tokens=[next(self._cache_token_generator)]))
-> 2245     result_future = self._worker_handler.control_conn.push(process_bundle_req)
   2246
   2247     split_results = []  # type: List[beam_fn_api_pb2.ProcessBundleSplitResponse]

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/portability/fn_api_runner.py in push(self, request)
   1557       self._uid_counter += 1
   1558       request.instruction_id = 'control_%s' % self._uid_counter
-> 1559     response = self.worker.do_instruction(request)
   1560     return ControlFuture(request.instruction_id, response)
   1561

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/sdk_worker.py in do_instruction(self, request)
    413       # E.g. if register is set, this will call self.register(request.register))
    414       return getattr(self, request_type)(
--> 415           getattr(request, request_type), request.instruction_id)
    416     else:
    417       raise NotImplementedError

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/sdk_worker.py in process_bundle(self, request, instruction_id)
    448         with self.maybe_profile(instruction_id):
    449           delayed_applications, requests_finalization = (
--> 450               bundle_processor.process_bundle(instruction_id))
    451           monitoring_infos = bundle_processor.monitoring_infos()
    452           monitoring_infos.extend(self.state_cache_metrics_fn())

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/bundle_processor.py in process_bundle(self, instruction_id)
    837         for data in data_channel.input_elements(instruction_id,
    838                                                 expected_transforms):
--> 839           input_op_by_transform_id[data.transform_id].process_encoded(data.data)
    840
    841       # Finish all operations.

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/bundle_processor.py in process_encoded(self, encoded_windowed_values)
    214       decoded_value = self.windowed_coder_impl.decode_from_stream(
    215           input_stream, True)
--> 216       self.output(decoded_value)
    217
    218   def try_split(self, fraction_of_remainder, total_buffer_size):

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/operations.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.worker.operations.Operation.output()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/operations.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.worker.operations.Operation.output()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/operations.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.worker.operations.SingletonConsumerSet.receive()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/operations.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.worker.operations.DoOperation.process()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/worker/operations.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.worker.operations.DoOperation.process()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.DoFnRunner.process()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.DoFnRunner._reraise_augmented()

/usr/local/lib/python3.6/dist-packages/future/utils/__init__.py in raise_with_traceback(exc, traceback)
    417         if traceback == Ellipsis:
    418             _, _, traceback = sys.exc_info()
--> 419         raise exc.with_traceback(traceback)
    420
    421 else:

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.DoFnRunner.process()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.PerWindowInvoker.invoke_process()

/usr/local/lib/python3.6/dist-packages/apache_beam/runners/common.cpython-36m-x86_64-linux-gnu.so in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window()

/usr/local/lib/python3.6/dist-packages/apache_beam/io/iobase.py in process(self, element, init_result)
   1080     for e in bundle[1]:  # values
   1081       writer.write(e)
-> 1082     return [window.TimestampedValue(writer.close(), timestamp.MAX_TIMESTAMP)]
   1083
   1084

/usr/local/lib/python3.6/dist-packages/apache_beam/io/filebasedsink.py in close(self)
    421
    422   def close(self):
--> 423     self.sink.close(self.temp_handle)
    424     return self.temp_shard_path

/usr/local/lib/python3.6/dist-packages/apache_beam/io/parquetio.py in close(self, writer)
    536   def close(self, writer):
    537     if len(self._buffer[0]) > 0:
--> 538       self._flush_buffer()
    539     if self._record_batches_byte_size > 0:
    540       self._write_batches(writer)

/usr/local/lib/python3.6/dist-packages/apache_beam/io/parquetio.py in _flush_buffer(self)
    568     for x in arrays:
    569       for b in x.buffers():
--> 570         size = size + b.size
    571     self._record_batches_byte_size = self._record_batches_byte_size + size

AttributeError: 'NoneType' object has no attribute 'size' [while running 'train/Save to parquet/Write/WriteImpl/WriteBundles']

I have seen that somebody is hard working on easierly loadable wikipedia. #129
Maybe I should wait few days for that version ?

Yes we (well @lhoestq) are very actively working on this.


Document backwards incompatible change in CHANGES.md

@isagalaev should we also add some tests that newly submitted languages and styles contains only restricted set of classes?

I had this idea too, but the problem is that you still can't check that the classes are applied correctly, it has to be done by a human as part of the review process anyway. I'm not sure if an automatic test will be useful, and to whom.

Fixed in bde9e97b8.


docs: fix README_PPX example

In commit 60db30dc7e93761d8c1c7da24301187c4b0ae29f the constructor Leaf was changed from taking two arguments to one argument. The code was not modified in all places to reflect this.
I attempted to follow the existing formatting.

Thanks


Update version for 2.0.0.M2 release

sprig cloud stream - 2.0.0.M2
spring cloud build - 2.0.0.M4

Codecov Report

Merging #1105 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master    #1105   +/-   ##
=========================================
  Coverage     57.18%   57.18%
  Complexity      670      670
=========================================
  Files           122      122
  Lines          3419     3419
  Branches        488      488
=========================================
  Hits           1955     1955
  Misses         1304     1304
  Partials        160      160

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 66526d1...d3500e2. Read the comment docs.


chore: update base image to 0.18.5

Emergency update due to a bug found with 0.18.4 (https://github.com/runatlantis/atlantis/issues/2104)
relates to https://github.com/runatlantis/atlantis/pull/2107

Thanks!

np


Hello All, I am trying to learn and create single cell RNA seq pipeline for my project. When I was doing quality control, I met this problem. Can anyone help me? Thank you a lot.

[ ] I have checked that this issue has not already been reported.
[ ] I have confirmed this bug exists on the latest version of scanpy.
[ ] (optional) I have confirmed this bug exists on the master branch of scanpy.

Note: Please read this guide detailing how to provide the necessary information for us to reproduce your bug.
Minimal code sample (that we can copy&paste without having any data)
mito_genes = adata.var_names.str.startswith('mt-')
# for each cell compute fraction of counts in mito genes vs. all genes
# the `.A1` is only necessary as X is sparse (to transform to a dense array after summing)
adata.obs['percent_mito'] = np.sum(
    adata[:, mito_genes].X, axis=1).A1 / np.sum(adata.X, axis=1).A1
# add the total counts per cell as observations-annotation to adata
adata.obs['n_counts'] = adata.X.sum(axis=1).A1

print(sum(mito_genes))

AttributeError                            Traceback (most recent call last)
<ipython-input-18-7f1a7fee3beb> in <module>
      2 # for each cell compute fraction of counts in mito genes vs. all genes
      3 # the `.A1` is only necessary as X is sparse (to transform to a dense array after summing)
----> 4 adata.obs['percent_mito'] = np.sum(
      5     adata[:, mito_genes].X, axis=1).A1 / np.sum(adata.X, axis=1).A1
      6 # add the total counts per cell as observations-annotation to adata

Versions

AttributeError: 'ArrayView' object has no attribute 'A1'

Hi,
I guess this issue might be more appropriate in the single-cell-tutorial github.
I assume that the AnnData object you are working with does not contain sparse data. In that case you can leave out the .A1 from your commands. Also, you're currently working with an ArrayView rather than an AnnData object, which you can change with a adata = adata.copy() line.

Thank you very much for the help and link to tutorial. It works for me


change the time unit of measurement in ScanContext

What problem does this PR solve?
Issue Number: ref #5926
Problem Summary:
What is changed and how it works?
Change the time unit of measurement in ScanContext
Check List
Tests

[ ] Unit test
[ ] Integration test
[ ] Manual test (add detailed scripts or steps below)
[ ] No code

Side effects

[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[ ] Breaking backward compatibility

Documentation

[ ] Affects user behaviors
[ ] Contains syntax changes
[ ] Contains variable changes
[ ] Contains experimental features
[ ] Changes MySQL compatibility

Release note

None

/run-all-tests

/cc @breezewish

Could you please give the reason about why do this?

Could you please give the reason about why do this?

Choose ns instead of ms as the time unit can improve the accuracy of statistics.

Could you please give the reason about why do this?

Choose ns instead of ms as the time unit can improve the accuracy of statistics.

/merge


Proposal: using multiple guidances in training

I'm planning on implementing a new class of guidance which can ease the use of multiple different guidances in training, for example zero123 SDS + DeepFloyd-IF SDS.

a MultipleGuidance which takes the config of multiple guidances and initialize them. Each guidance has a suffix string which is appended to the keys of its returned dict so that we can distinguish returned values of the same name from different guidances (e.g., loss_sds_zero123 and `loss_sds_if).
a CombinedGuidance which inherits MultipleGuidance. It  evaluates every guidance at each iteration.
an IterativeGuidance which inherits MultipleGuidance. It only evaluates some of the guidances at each iteration. For example, zero123 at even steps and  IF at odd steps.

Any suggestions?

Another option is to provide a system that integrates different guidances, given the perspective that each guidance is actually equivalent to a loss. So I guess it is also a chance for us to incorporate common losses into systems.

We have a version of this implemented in zero123, because we take guidance from ref + zero123. I expanded that to take guidance from ref + SD/DF + zero123. You could take a look, it's not as modular as having a separate MixtureGuidance class though.

@bennyguo Hi when are you going to release this PR? I am very looking forward to this feature.
This is also very relevant to my recent work: Magic123, which uses SDS plus Zero123-SDS guidance for image-to-3D generation. Once this feature is launched, Magic123 can be seamless integrated into this repo. Magic123 achieves outstanding performance in single image-to-3D generation using both 2D and pesudo 3D (zero123) diffusion guidance.
@voletiv Very interesting. Looks like you have a similar idea as our work.  I will check your repo when I am free. You can also take a quick look at our project webpage: https://guochengqian.github.io/project/magic123
We arxived it one month ago.

@guochengqian Actually my intention behind this was to reproduce Magic123😂 Good work!
I did a quick adaptation to support training with the zero123 guidance and the SD guidance at the same time but did not get very good results. Are you interested in implementing Magic123 in threestudio? I can share my branch as a start point.

Cool! I can take a look, but not sure I have time to do it or not. I am busy with my another ongoing project at Snap.
Anyway, please share your branch. It might only take me a few hours to get it right.
I will also share my code based on stable dreamfusion today or tomorrow on this github repo: https://github.com/guochengqian/Magic123/issues/1

@guochengqian Cheers on the code release! I might want to read your code first and try to reproduce it in threestudio :) I'll let you know if I have any problems about the implementation.

我们在 Zero123 中实现了一个版本，因为我们接受 ref + Zero123 的指导。我将其扩展为接受 ref + SD/DF + Zero123 的指导。您可以看一下，它不像单独的 MixtureGuidance 类那样模块化。

Cool! Where can I see this?


Ability to compute ordinal numbers from transactions in mempool

Draft PR https://github.com/hirosystems/hord/pull/133

Hello world


rRNA precursors - synonym and possible ntr

Hi,

Can SO:0000325 rRNA_large_subunit_primary_transcript have the synonym "35S rRNA primary transcript"? It can be a narrow synonym if there are other large subunit primary transcripts of different sizes (the 35S is for budding and fission yeast; I don't know a thing about other species).
And would SO include any of the rRNA processing intermediates? I think it could get pretty complicated -- PMID:21385875 shows intermediates of 27S (2 forms, 27SA and 27SB, before and after a bit of trimming, probably by an exonuclease), 20S, 26S, and 7S. PMID:10690410 (a very good review) describes even more intermediates observed in budding yeast.
The term I would have a use for (phenotype ontology cross-product def) would be one for any of the 27S intermediates:
name: 27S_rRNA_precursor
def: "Any RNA molecule of 27S that is derived by cleavage from the ribosomal RNA large subunit primary transcript, and contains the 5.8S and 25S rRNA sequences." [PomBase:mah, PMID:21385875, PMID:10690410]
relationship: derives_from SO:0000325 ! rRNA_large_subunit_primary_transcript
I guess the is_a parent could be transcript SO:0000673 -- it's neither primary nor fully mature ...
Thanks,
Midor

Response from @keilbeck
Hey Midori
I added the synoym as requested.
The other terms need a bit more thought on my behalf.
I will get back to you
--Karen


Table component accessibility - extra column may cause confusion (AVT 3)

Two issues (which seem to be related to the same 'th' that's added to the right of the table).

JAWS reads 11 columns instead of 10 columns for the table.
The right extreme of the table has a visual defect at certain resolutions, visible in the below screenshot. Note how there is a gap between the end of the highlighted row and the right border.

Is this a feature request (new component, new icon), a bug, or a general issue?

bug

Is this issue related to a specific component?

Table component

What browser are you working in?

Firefox 63.0.3 (64-bit)

What version of the Carbon Design System are you using?

"carbon-components": "9.53.2",
"carbon-components-angular": "2.0.8",

What offering/product do you work on? Any pressing ship or release dates we should be aware of?

IWR

@cal-smith @zvonimirfras Hi guys, I'm still seeing the issue mentioned above. IMO the border gap stands out and makes the table appear less polished  - is there any plan to address this? Thanks.

Yep, we've got this in our Q1 project so it'll get some eyes on it soon ...


Hand Tracking Multiple Hands

Hey,
In your blog, you released a hand-tracking model. In the blog, it mentioned scalability to multiple hands. How do you enable this on the software as it is currently only tracking one hand? I am not too well versed with Mediapipe / hand-tracking, so an in-depth explained answer would be perfect!
Thanks

Duplicate of #32 We don't support this currently

@eknight7 FYI
We will update this issue in the future once we have support

@pranay-agra With the new release https://github.com/google/mediapipe/releases/tag/v0.6.4, we have multi-hand tracking examples:
https://github.com/google/mediapipe/blob/master/mediapipe/docs/multi_hand_tracking_mobile_gpu.md
https://github.com/google/mediapipe/blob/master/mediapipe/docs/multi_hand_tracking_desktop.md


Enable tcp KeepAlive

With out keep alive, lxc will block indefinitely when there is network change.

This pull request didn't trigger Jenkins as its author isn't in the whitelist.
An organization member must perform one of the following:

To have this branch tested by Jenkins, use the "ok to test" command.
To have a one time test done, use the "test this please" command.

Those commands are simple Github comments of the format: "jenkins: COMMAND"

@Catramen Hi, please include the Signed-off-by line in your commit message otherwise we can't review your contribution (see CONTRIBUTING.md).

done, thx

@Catramen hmm, there's something wrong going on with your branch, it's showing 150 commits or so here :)

As your commit is properly signed off, I'll just rebase your branch for you which should fix things, then have it go through CI.

jenkins: test this please


still some bug in python 3.8

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)

on the other side some functions can be import but i'm trying to understand how this works
class MyClass(object):
    def __init__(self):
        self.__hidden = 1
        self._private = 2
        self.public = 3

# Get an instance of your class
myinst = MyClass()

# import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)

variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)

prints  3 - 2 - 1  but is this the expected behaviour, i thought i was protected
Am i doing this right ?
thanks

Your test code looks ok, and should work to raise an exception as you
expected.
I am traveling, and dealing with a personal emergency, and likely wont get
a chance to debug for a couple of weeks. Sorry.
On Wed, Jan 13, 2021, 21:43 Guy Huinen<EMAIL_ADDRESS>wrote:

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)
on the other side some functions can be import but i'm trying to
understand how this works
class MyClass(object):
def init(self):
self.__hidden = 1
self._private = 2
self.public = 3
Get an instance of your class
myinst = MyClass()
import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)
prints 3 - 2 - 1 but is this the expected behaviour, i thought i was
protected
Am i doing this right ?
thanks
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sundarnagarajan/python_protected_class/issues/3, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AC3K3S4AUNTNSP5JLOFFPZTSZXBBHANCNFSM4WBBGZ6Q
.

Your test code looks ok, and should work to raise an exception as you
expected.
I am traveling, and dealing with a personal emergency, and likely wont get
a chance to debug for a couple of weeks. Sorry.
On Wed, Jan 13, 2021, 21:43 Guy Huinen<EMAIL_ADDRESS>wrote:

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)
on the other side some functions can be import but i'm trying to
understand how this works
class MyClass(object):
def init(self):
self.__hidden = 1
self._private = 2
self.public = 3
Get an instance of your class
myinst = MyClass()
import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)
prints 3 - 2 - 1 but is this the expected behaviour, i thought i was
protected
Am i doing this right ?
thanks
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sundarnagarajan/python_protected_class/issues/3, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AC3K3S4AUNTNSP5JLOFFPZTSZXBBHANCNFSM4WBBGZ6Q
.

As a quick test, you could try wrapping your instance with private()
instead of protect(). Both should work the same for your current test code
but private() wrapper is simpler code path (inside protected_class module).
On Thu, Jan 14, 2021, 10:40 Sundar Nagarajan<EMAIL_ADDRESS>wrote:

Your test code looks ok, and should work to raise an exception as you
expected.
I am traveling, and dealing with a personal emergency, and likely wont get
a chance to debug for a couple of weeks. Sorry.
On Wed, Jan 13, 2021, 21:43 Guy Huinen<EMAIL_ADDRESS>wrote:

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)
on the other side some functions can be import but i'm trying to
understand how this works
class MyClass(object):
def init(self):
self.__hidden = 1
self._private = 2
self.public = 3
Get an instance of your class
myinst = MyClass()
import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)
prints 3 - 2 - 1 but is this the expected behaviour, i thought i was
protected
Am i doing this right ?
thanks
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sundarnagarajan/python_protected_class/issues/3, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AC3K3S4AUNTNSP5JLOFFPZTSZXBBHANCNFSM4WBBGZ6Q
.

As a quick test, you could try wrapping your instance with private()
instead of protect(). Both should work the same for your current test code
but private() wrapper is simpler code path (inside protected_class module).
On Thu, Jan 14, 2021, 10:40 Sundar Nagarajan<EMAIL_ADDRESS>wrote:

Your test code looks ok, and should work to raise an exception as you
expected.
I am traveling, and dealing with a personal emergency, and likely wont get
a chance to debug for a couple of weeks. Sorry.
On Wed, Jan 13, 2021, 21:43 Guy Huinen<EMAIL_ADDRESS>wrote:

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)
on the other side some functions can be import but i'm trying to
understand how this works
class MyClass(object):
def init(self):
self.__hidden = 1
self._private = 2
self.public = 3
Get an instance of your class
myinst = MyClass()
import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)
prints 3 - 2 - 1 but is this the expected behaviour, i thought i was
protected
Am i doing this right ?
thanks
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sundarnagarajan/python_protected_class/issues/3, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AC3K3S4AUNTNSP5JLOFFPZTSZXBBHANCNFSM4WBBGZ6Q
.

nceOK, I did get a few mins to look at your example, and unfortunately,
your test case has a problem.
The protection of attributes is on the WRAPPED object and not on the
ORIGINAL instance.
So in your example:
This line:
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
Should be:
variables = f"{wrapped.public} - {wrapped._private} -
{wrapped._MyClass__hidden}"
This will produce an exception as expected.
On Wed, Jan 13, 2021 at 9:43 PM Guy Huinen<EMAIL_ADDRESS>wrote:

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)
on the other side some functions can be import but i'm trying to
understand how this works
class MyClass(object):
def init(self):
self.__hidden = 1
self._private = 2
self.public = 3
Get an instance of your class
myinst = MyClass()
import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)
prints 3 - 2 - 1 but is this the expected behaviour, i thought i was
protected
Am i doing this right ?
thanks
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sundarnagarajan/python_protected_class/issues/3, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AC3K3S4AUNTNSP5JLOFFPZTSZXBBHANCNFSM4WBBGZ6Q
.

nceOK, I did get a few mins to look at your example, and unfortunately,
your test case has a problem.
The protection of attributes is on the WRAPPED object and not on the
ORIGINAL instance.
So in your example:
This line:
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
Should be:
variables = f"{wrapped.public} - {wrapped._private} -
{wrapped._MyClass__hidden}"
This will produce an exception as expected.
On Wed, Jan 13, 2021 at 9:43 PM Guy Huinen<EMAIL_ADDRESS>wrote:

thanks for fixing the code to work with python 3.8
i though face another problem when i run the example
error
ImportError: cannot import name 'Protected' from 'protected_class' (/usr/local/lib/python3.8/site-packages/protected_class.cpython-38-x86_64-linux-gnu.so)
on the other side some functions can be import but i'm trying to
understand how this works
class MyClass(object):
def init(self):
self.__hidden = 1
self._private = 2
self.public = 3
Get an instance of your class
myinst = MyClass()
import + ONE line to wrap and protect class attributes
from protected_class import protect
wrapped = protect(myinst, hide_data = True,hide_all = True , hide_dunder = True, hide_private = True)
variables = f"{myinst.public} - {myinst._private} - {myinst._MyClass__hidden}"
print(variables)
prints 3 - 2 - 1 but is this the expected behaviour, i thought i was
protected
Am i doing this right ?
thanks
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/sundarnagarajan/python_protected_class/issues/3, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AC3K3S4AUNTNSP5JLOFFPZTSZXBBHANCNFSM4WBBGZ6Q
.

Closing this issue - please see my explanation above.


Allow declaring a common root for routes.

It would be cool if we could, when declaring routes, specify a context for a given set of routes.
It's not annoying per se, but it would be nice to see some structure.
On.context("/context", () -> {
    On.get("/thing1").json(...);
    On.get("/thing2").json(...);
})

I just realise it could be given the setup to setup the routes.
On.context("/context", setup -> {
    setup.get("/thing1").json(...);
    setup.get("/thing2").json(...);
});


BUG: align with broadcast_axis, #13194

Closes #13194

Implemented the easy fix
Future work : To implement broadcast axis remaining functionality.
All tests in test_generic.py passed.

tests
we r on 0.18.2

Hi,
I seem to have made the documentation in the wrong file. I will correct it and push the changes.
Rest all is OK, right?
This is my first pull request to pandas, sorry for the noob errors.

@jreback I have corrected the documentation to the proper version file. Is this everything?
I have ran the tests also.
Am I missing something?

you need to add tests which fail before this patch and pass after

Apart from the indispensable unit test, I'd propose to move the lines:
if axis is not None:
    axis = self._get_axis_number(axis)

to right before the if broadcast_axis == 1 block, such that broadcasting will work also in case align is called with axis='index' instead of axis=0.
Thanks!

[Current coverage][cc-pull] is 84.12%

Merging [#13198][cc-pull] into [master][cc-base-branch] will not change coverage

@@             master     #13198   diff @@
==========================================
  Files           138        138
  Lines         50388      50388
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
  Hits          42386      42386
  Misses         8002       8002
  Partials          0          0

Powered by Codecov. Last updated by [4e4a7d9...b4867df][cc-compare]
[cc-base-branch]: https://codecov.io/gh/pydata/pandas/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/pydata/pandas/compare/4e4a7d9ae5b3c05b21dc0a0f3c12648236ec586e...b4867df72de5978782ea4424e6fe2a07275cce81
[cc-pull]: https://codecov.io/gh/pydata/pandas/pull/13198?src=pr

@jreback @kdebrab I've included the unit test and have also moved the location of the axis check.
Can you please take a look?

@jreback Have made the required changes.
Please comment if something's lacking.

Can u add tests with:

alternately different Index to clheck left and right join.
Series.align(DataFrame)

@sinhrks Sure. It's late night here right now. I will do this in the morning.

@sinhrks I've made some changes. Please take a look and comment. This is what you meant right?

@jreback Done. Kindly check and comment.

@jreback
    right = df.align(ts, join='right', axis=1, broadcast_axis='index')
    expected1_right = DataFrame([[pd.np.nan, pd.np.nan, pd.np.nan],
                                 [pd.np.nan, pd.np.nan, pd.np,nan]],
                                columns=[0, 1, 2])
    expected2_right = Series([5., 6., 7.])
    assert_frame_equal(right[0], expected1_right)
    assert_series_equal(right[1], expected2_right)

While trying to run the above code, nosetests gives the error
AssertionError: Series.index are different
    Series.index classes are not equivalent
    [left]:  Index([u'A', u'B'], dtype='object')
    [right]: RangeIndex(start=0, stop=2, step=1)

However, upon running in the interpreter

right = df.align(ts, join='right', axis=1, broadcast_axis='index')
right[1]
0    5.0
1    6.0
2    7.0
dtype: float64
right[1].index
RangeIndex(start=0, stop=3, step=1)
expected2_right = Series([5., 6., 7.])
expected2_right.index
RangeIndex(start=0, stop=3, step=1)

We find that both indexes are same.
I am currently in pandas_dev environment.
Is this something assert_series_frame is doing?

can you rebase / update?

@jreback I'm not sure I understand. I have rebased my_branch with master.

doesn't look like it
you need to push

@jreback
I have used the following commands:
git checkout my_branch
git rebase master
git push -u origin my_branch

Sorry I closed my mistake

got rebase origin/master

got -> git

you are rebasing to a local master which is not updated

@jreback
I followed the steps:

git remote add ups https://github.com/pydata/pandas.git
git fetch ups
git checkout master
git rebase ups/master

First, rewinding head to replay your work on top of it...
Applying: BUG: GH13194 fixed
Applying: DOC : Change in release notes
Using index info to reconstruct a base tree...
A	doc/source/whatsnew/v0.18.2.txt
:19: trailing whitespace.

Fixed the bug in DataFrame.align() which was giving wrong output when supplied with the join argument. (:issue:13194)
warning: 1 line adds whitespace errors.
Falling back to patching base and 3-way merge...
CONFLICT (modify/delete): doc/source/whatsnew/v0.18.2.txt deleted in HEAD and modified in DOC : Change in release notes. Version DOC : Change in release notes of doc/source/whatsnew/v0.18.2.txt left in tree.
Failed to merge in the changes.
Patch failed at 0002 DOC : Change in release notes
The copy of the patch that failed is found in:
/home/pfrcks/issues/pandas-pfrcks/.git/rebase-apply/patch
When you have resolved this problem, run "git rebase --continue".
If you prefer to skip this patch, run "git rebase --skip" instead.
To check out the original branch and stop rebasing, run "git rebase --abort".

I removed the whitespace error and then synced the changes but still I am getting the same issue.

closing, but if you want to update / rebase. pls reopen


ablation study for the "mtl" and "feature fusion" strategies

Hi, yaoyao,
Thanks for your interesting work.
I did some ablation study for these two components(mtl and feature fusion), i.e., 1. a plain network (resnet32_cifar) is constructed for tg_model in your code; 2. extracting features or outputs without calling the function process_input_fp; 3. replace herding exemplars by self.mnemonics (cumulated from phase 0 to i) under the framework of LUCIR[1]. The experiments show that without the two components, the performance after the first incremental learning is 63.47 instead of 69.05 (obtained by directly running your training code).
In my scenario, I'm only allowed to use a plain network (e.g., resnet-like network) and also without feature fusion. I'm wondering if it is necessary for the Mnemonics method to work with "mtl" and "feature fusion".
[1] Hou, S., Pan, X., Loy, C. C., Wang, Z., & Lin, D. (2019). Learning a unified classifier incrementally via rebalancing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 831-839).

Hi Michaelyq,
Thanks for your interest in our work.
I think you're using an old version of our released code with some bugs. The initialization of mnemonics will assign wrong labels to the exemplars. Please check if this bug will affect you.
We're fixing some bugs for this project so we temporarily remove the training code in this repository. However, we have already fixed the bugs that may affect you. You may download our new code using this link: Google Drive. This is also a preliminary version. You may use the code in train_v2.0 to run the ablation experiments for the feature fusion operation and the code in train_v1.0 to run the experiments without the feature fusion operation.
For the feature fusion operation, we have the ablation results as follows,

Setting
Acc. for the last phase
Mean Acc.

Ours
58.21%
66.51%

2x free
54.18%
62.26%

Baseline
54.30%
63.17%

The improvements are not from the additional model capacity. The ablation results are shown in the table for the setting --nb_cl_fg=50 --nb_cl=10 --nb_protos 20 --imprint_weights. We can observe that using 2x free directly will not improve the results. (Please note that the implementation for the ablation experiment 2x free is already included in the current repository, you may use python main.py --nb_cl 10 --imprint_weights --fusion_mode free to run it.)
For the weight transfer operation, please please kindly refer to the Supplementary materials, Section B for details: arXiv link. Our mnemonics exemplar work with the weight transfer operation together to achieve the best accuracy.
Please don't hesitate to contact us or add further comments in this issue.

Thanks for your constructive suggestions. The improper initialization of self.mnemonics in the old version may affect the performance of experiments I did. I will try your updated training code later.
According to your experimental results, it seems that the performance gain is achieved by the composition of weight transfer operation (WTO) and feature fusion together (not along with either side). I think it is sensible since self.network_mtl and self.network are two different networks and heterogeneous architectures should be better than the homogeneous architectures(tg_model = self.network() and free_model = self.network()).
However, I think the most important contribution (by going through your paper) should be the self-learnt exemplars (self.mnemonics in your code). So I did the 3rd ablation experiment (excluding WTO and feature fusion) first by replacing the herding exemplars in LUCIR with self.mnemonics, in order to see the contribution of self.mnemonics to the performance gain. I think it is very necessary to verify this point fist to see if dataset distillation-like techniques can be applied to the incremental learning field.
It will be much appreciated if you have the ablation experiment for my 3rd experimental setting. Hopefully I explain it clearly.
By the way, in your train_v2.0 version, is the variable X_train_cumuls accumulated from phase 0 to i using updated self.mnemonics for each phase? Or using original images from phase 0 to i-1 and updated self.mnemonicsin the current phase?
Thanks in advance!
Michael

Hi Michael,
The feature fusion operation is only applied in train_v2.0. If you hope to run the experiments without the feature fusion operation, you may use  train_v1.0 directly.
In Table 2 of the main paper, we provide ablation results for different exemplar methods based on the network with weight transfer operation. I think these ablation results can partially answer your question. As we have claimed, our mnemonics exemplars work with the weight transfer operation together to achieve the best accuracy. The ablation experiment you mentioned is reasonable. Thanks for the suggestion. We'll do that in our future work.
In train_v2.0, X_train_cumuls accumulated from phase 0 to i using updated self.mnemonics for each phase. After updating, the new exemplars will be assigned to the original dataset and we'll get these updated samples for the next phase.
Best,
Yaoyao

Thanks for your kind reply.


omgd infra destroy should remove omgd.servers.host IP address value from yml file of profile

closed in PR #258


Fix UB in Graphics::get_debug_bitmap()

Adds state to track ownership of the bitmap, implying that it is safe to free the underlying memory. The only bitmap that is not owned, AFAICT, is the debug bitmap in the simulator.
Fixes #57

Thank you!


removed the default outline style of select:focus for theme-select an…

Description

the theme-select and language-select which on the top-right nav part of astro doc has a default blue outline after clicking
remove the outline style might be better

before

##### after

Hello! Thank you for opening your first PR to Starlight! ✨
Here’s what will happen next:

Our GitHub bots will run to check your changes.
If they spot any issues you will see some error messages on this PR.
Don’t hesitate to ask any questions if you’re not sure what these mean!

In a few minutes, you’ll be able to see a preview of your changes on Vercel 🤩

One or more of our maintainers will take a look and may ask you to make changes.
We try to be responsive, but don’t worry if this takes a few days.


Simplify Kustomize patches

By taking advantage of Kustomize's patchesJson6902, we can remove some duplicated YAMLs and just applying the changes we need.

Updated to use patch files instead of inline patches, since it doesn't seem to be supported by kubectl apply -k yet.


IA-1976: Enable personalized user guide per IASO account

Explain what problem this PR is resolving

For each acccount, only IASO user manual was accessible even for POLIO account
This ticket is to enable personalized user guide per account
Related JIRA tickets : IA-1976

Self proofreading checklist

[x] Did I use eslint and black formatters
[x] Is my code clear enough and well documented
[ ] Are my typescript files well typed
[ ] New translations have been added or updated if new strings have been introduced in the frontend
[x] My migrations file are included
[ ] Are there enough tests
[ ] Documentation has been included (for new feature)

Changes

Create a migration to add user_manual_path to account
Add user_manual_path field to account as_dict method
On the front check if the account user_manual_path is null, if yes display the default user manual if not display the account user manual path

How to test

Edit an account by adding a personalized user guide link
Go on the bottom of the sidebar and check if the user manual is the one added on the account

@cypress


run and run_and_measure should have more compatible arguments

It can be slow to port code from run to run_and_measure because of their differing arguments, the latter of which is used when running measurements on the QPU.

In the future run will be the only way to interact with the QPU.

the new QuantumComputer abstraction has run and run_and_measure, but their distinct usages and arguments are clear


RR-673 - Initial skeleton route, controller and view for In Prison Courses & Qualifications

This PR introduces the initial skeleton route, controller and view for In Prison Courses & Qualifications
The route is sat behind the feature toggle; and the view is basic and pretty much empty.
But this allows us to complete the work preceding this page, and to be able to link to this page. The rest of RR-673 will start to flesh out the rest of the functionality of this page.
@chrimesdev The URL that this route sets up is /plan/{{ prison number }}/in-prison-courses-and-qualifications - this is what you will want to link to on the "View all" link in your current story 👍

Looks good - will rebase my branch with this and update the links!


Object of type UUID is not JSON serializable

Looks like TypeAdapter.dump_python() miss one critical argument - mode="json", as result not all objects are properly serialised
STR:

Create a Payload model

from pydantic import BaseModel
from uuid import UUID, uuid4

class A(BaseModel):
    id: UUID

Then use it in Protocol

class TheClient(Protocol):
    @http_method("POST")
    @path("/fix-me")
    def fix_json_dump(self, payload: Payload[A]) -> SomeSuccesfullResponce:
        ...

 Unfortunately, fixing it isn't that simple: it works alright, but it defeats the purpose of having different backends and serialization formats (some have a special representation for e.g. UUID)


Update service load balancer finalizer doc for beta

Ref https://github.com/kubernetes/enhancements/issues/980. Updating service load balancer finalizer doc to reflect the beta state.
cc @daminisatya

This should go in after https://github.com/kubernetes/kubernetes/pull/81691.
/hold

/approve


Fix warnings raised in tests

Running pytest tests/* --typeguard-packages=strictly_typed_pandas,tests yielded a few warnings I fixed up.
The only warning left is
tests/test_type_validation.py::test_numpy_types
  /usr/local/google/home/caneff/git/strictly_typed_pandas/strictly_typed_pandas/validate_schema.py:54: DeprecationWarning: Converting `np.integer` or `np.signedinteger` to a dtype is deprecated. The current result is `np.dtype(np.int_)` which is not strictly correct. Note that the result depends on the system. To ensure stable results use may want to use `np.int64` or `np.int32`.
    if dtype_observed == dtype_expected or np.issubdtype(dtype_observed, dtype_expected):

Couldn't figure out how to work around that one though. Hoping you had some thoughts @nanne-aben

Thanks for picking this up @caneff ! The np.integer one looks like some legacy numpy data type. If I'm not mistaken, it's only used in the tests, right? I think we should remove any reference to np.integer (or other datatypes that raise such a warning).
We used to support really old versions of pandas and numpy, but I've stopped explicitly testing those old versions a while ago. I think this is a good moment to clean up those legacy bits.

Thanks for picking this up @caneff ! The np.integer one looks like some legacy numpy data type. If I'm not mistaken, it's only used in the tests, right? I think we should remove any reference to np.integer (or other datatypes that raise such a warning).
We used to support really old versions of pandas and numpy, but I've stopped explicitly testing those old versions a while ago. I think this is a good moment to clean up those legacy bits.

OK got rid of it (yes it was only in the test)


fix bug preflight from apollo

resetStore: Store reset while query was in flight.
https://github.com/apollographql/apollo-client/issues/2919#issuecomment-378790109

Oh nice! Glad we can finally get rid of that error!

you're welcome 🥇 now pay me in crypto :P

I could give you half of all the Bitcoin I own, would that work?

@SachaG that's very generous! Deal!

OK, here's zero Bitcoins :)


vscode terminal tabs Chinese path garbled

Type: Bug
When I use the zsh terminal in vscode, and the current directory name contains Chinese characters, the tabs Chinese path in the vscode terminal is garbled
VS Code version: Code 1.74.2 (e8a3071ea4344d9d48ef8a4df2c097372b0c5161, 2022-12-20T10:26:09.430Z)
OS version: Darwin x64 20.6.0
Modes:
Sandboxed: No

System Info

Item
Value

CPUs
Intel(R) Xeon(R) CPU E3-1230 v3 @ 3.30GHz (8 x 3300)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_renderer: enabled_onvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: disabled_off

Load (avg)
2, 2, 2

Memory (System)
16.00GB (3.05GB free)

Process Argv
Linux三剑客 --crash-reporter-id f997d75e-d0bf-4882-a41f-150202e05561

Screen Reader
no

VM
0%

Extensions (36)

Extension
Author (truncated)
Version

vscode-eslint
dba
2.2.6

githistory
don
0.6.19

vscode-html-css
ecm
1.13.1

auto-close-tag
for
0.5.14

auto-rename-tag
for
0.1.10

nsis
idl
3.52.0

intellij-idea-keybindings
k--
1.5.5

isort
ms-
2022.8.0

python
ms-
2022.20.1

vscode-pylance
ms-
2023.1.10

jupyter
ms-
2022.11.1003412109

jupyter-keymap
ms-
1.0.0

jupyter-renderers
ms-
1.0.12

vscode-jupyter-cell-tags
ms-
0.1.6

vscode-jupyter-slideshow
ms-
0.1.5

vetur
oct
0.36.1

vscode-boot-dev-pack
Piv
0.2.0

vscode-spring-boot
Piv
1.43.0

java
red
1.13.0

vscode-xml
red
0.23.0

LiveServer
rit
5.7.9

snippets-ranger
rob
0.22.1

rust-analyzer
rus
0.3.1348

vscode-lldb
vad
1.8.1

intellicode-api-usage-examples
Vis
0.2.6

vscodeintellicode
Vis
1.2.30

vscode-java-debug
vsc
0.47.0

vscode-java-dependency
vsc
0.21.1

vscode-java-pack
vsc
0.25.7

vscode-java-test
vsc
0.37.1

vscode-lombok
vsc
1.1.0

vscode-maven
vsc
0.40.2

vscode-spring-boot-dashboard
vsc
0.9.0

vscode-spring-initializr
vsc
0.11.1

JavaScriptSnippets
xab
1.8.0

vscode-java-ibatisx
yan
2022.12.16240001

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
pythonvspyl392:30443607
vserr242cf:30382550
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
vscoreces:30445986
pythondataviewer:30285071
vscod805:30301674
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
cmake_vspar411:30581797
vsaa593cf:30376535
pythonvs932:30410667
cppdebug:30492333
vsclangdf:30486550
c4g48928:30535728
dsvsc012:30540252
azure-dev_surveyone:30548225
pyindex848cf:30577861
nodejswelcome1cf:30587006
3biah626:30602489
iaj6b796:30613358
89544117:30613380
fim-prod:30623723

the screenshot  as follows

I believe this is already fixed, can you see if you can reproduce in the Insiders build?
/label info-needed

Ok I'll try it out as soon as I get time and give you the results

I downloaded the latest vscode-insiders, the problem of garbled characters has been fixed, but the terminal tabs on the right only show zsh, is it correct?

vscode-insiders version info as follow
Version: 1.75.0-insider (Universal)
Commit: e7b5449579249db344d473370d56a5df9446c826
Date: 2023-01-10T05:21:34.436Z
Electron: 19.1.9
Chromium: 102.0.5005.194
Node.js: 16.14.2
V8: <IP_ADDRESS>-electron.0
OS: Darwin x64 20.6.0
Sandboxed: Yes

what are you expecting them to show if not zsh?

that is the problem after an update of vscode. if should be look like this:

but also need the {cwd} by default. the {cwd} here is not correctly.
that is not a shell configuration issue, mostly the vscode issue.

that is the problem after an update of vscode. if should be look like this:

but also need the {cwd} by default. the {cwd} here is not correctly.
that is not a shell configuration issue, mostly the vscode issue.

Update:
upgrad to latest version of vscode, it fixed.


[FS] Remove in-progress transactions while reorging

If this happens in the wallet it should happen inside of DeleteBlock for only the relevant transactions.

Also just for reference note that the store also calls RemoveBlocks:

Yo @quantumagi that's not correct. We want to get rid of ALL in-progress transactions during a reorg, the transaction / deposit matching needs to start from scratch.

Thanks for the mention of input keys updating. This is useful, I'll add it.

Please include a test case that builds two partial transfers with UTXO's spanning two consecutive blocks such that the first transactions UTXO come from block A and the second transactions UTXO's come from block B. Set it up so that the first transfer is based on the source chain block X and the second on source chain block Y. After rewinding block B the NextMatureDepositHeight should point at block Y. Now redo the transfer associated with block Y and check that the wallet contains no duplicates. Verify that the changes in this PR improve the outcome.

Our integration tests for the federation are currently skipped, even for less complex scenarios. So while a test for that case is desirable, I doubt it would be more stable than the tests we are currently skipping.

@zeptin, its not an integration tests and is comparable in complexity and function to the other tests in the CrossChainTransferStoreTests class that it will be joining. In fact those can serve as a good starting point.

We want to get rid of ALL in-progress transactions during a reorg,

If you mean for deposits to the target chain yes we want to get rid of all of them down to the fork point, however thous should be done in the method RefreshInputKeysLookupLock inside wallet.Remove(blocks)

RefreshInputKeysLookupLock doesn't actually do that. It just changes the lookups.
I'll add it in, but we still need the RemoveTransientTransactions().
I'd really like to add tests but this is something that occurs sporadically, I don't know that it will be easily possible.

@codingupastorm , I've added the test case to PR 3560. Please merge it into this PR.

I've moved the important code from this PR across to #3560.

Assuming that #3560 fixes this so closing.


Multiplex flavor plugins by type in a single RPC endpoint.

Similar to #360 this PR adds support for sub-types in a flavor plugin.

Same naming mechanism:  plugin.Name := $lookup[/$type] where $type is defined by the name a flavor SPI implementation is bound in the function to export the object in the RPC server (the PluginServerWithTypes method.
Added tests
Updated the swarm flavor plugin as two spi flavor.Plugin implementations: one as manager and one as worker -- so the Plugin names should be flavor-swarm/manager and flavor-swarm/worker.
Swarm flavor plugin no longer needs to implement a Type switch in its own Spec schema.  Instead, the switch is handled at the RPC layer.
Added a new e2e test case, scripts/e2e-swarm.sh and updated the scripts/e2e-test-plugins.json template to describe how to start up the vagrant and swarm flavor plugins.

Please sign your commits following these rules:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "multiplex-flavor" git@github.com:chungers/infrakit.git somewhere
$ cd somewhere
$ git rebase -i HEAD~842354446536
editor opens
change each 'pick' to 'edit'
save the file and quit
$ git commit --amend -s --no-edit
$ git rebase --continue # and repeat the amend for each commit
$ git push -f

Amending updates the existing PR. You DO NOT need to open a new one.

Current coverage is 64.60% (diff: 50.76%)

Merging #364 into master will decrease coverage by 0.55%

@@             master       #364   diff @@
==========================================
  Files            45         47     +2
  Lines          2167       2243    +76
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
+ Hits           1412       1449    +37
- Misses          610        636    +26
- Partials        145        158    +13

Powered by Codecov. Last update a7d5dab...9e414b0


Xvideos: Video exists, but YouTube-DL gives 404 error

Checklist

[X] I'm reporting a broken site support
[X] I've verified that I'm running youtube-dl version 2021.03.25
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones

Verbose log

PASTE VERBOSE LOG HERE

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://www.xvideos.com/video60816899/how_to_make_a_super_realistic_pussy_at_home_without_money_version_2_']
[debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[debug] youtube-dl version 2021.03.25
[debug] Python version 3.4.4 (CPython) - Windows-XP-5.1.2600-SP3
[debug] exe versions: ffmpeg N-93954-g76ef18fd39
[debug] Proxy map: {}
[debug] Default format spec: bestvideo+bestaudio/best
ERROR: unable to download video data: HTTP Error 404: Not Found
Traceback (most recent call last):
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp5nc448kk\build\youtube_dl\YoutubeDL.py", line 1967, in process_info
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp5nc448kk\build\youtube_dl\YoutubeDL.py", line 1906, in dl
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp5nc448kk\build\youtube_dl\downloader\common.py", line 366, in download
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp5nc448kk\build\youtube_dl\downloader\hls.py", line 64, in real_download
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp5nc448kk\build\youtube_dl\YoutubeDL.py", line 2279, in urlopen
File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
urllib.error.HTTPError: HTTP Error 404: Not Found
Description

WRITE DESCRIPTION HERE
This video popped up on the front page of Xvideos, so I decided to try downloading it. YouTube-DL gave a 404: Not found error, but the video does play in the browser. It can also be downloaded if you view the page source and search for MP4, then feed that URL to the browser.
I tried some previous versions going back to November and they gave the same result.

Even though it's contained in the log, I neglected to add a copy of the URL by itself and I'm not able to edit my post, so here's the URL;
https://www.xvideos.com/video60816899/how_to_make_a_super_realistic_pussy_at_home_without_money_version_2_

stop cooming


[Languages] Creating a Python Package and Distributing it on GitHub

Topic Suggestion
Creating a Python Package and Distributing it on GitHub
Writing sample(s):
N/A
Proposed title of the article
Creating a Python Package and Distributing it on GitHub
Proposed article introduction
Many a time we write Python scripts and projects which we wonder what to do with afterward. Instead, we could package these scripts and projects to be able to share and reuse in new upcoming projects instead of rebuilding the wheel.
In this article, we will be packaging a Python script and distributing it on GitHub. We will first transform our code into a python package for reusability(It can be installed). We’ll then distribute the package to a Github repository for accessibility.
Key takeaways
By the end of this tutorial, the reader should be able to:

Understand the requirements of a Python package.
Build a Python package or transform an existing project into a package.
Install the self-built package from the repository using pip.
Update an existing package.
Distribute a package on GitHub.

Article quality
This article will cover more in-depth content that the documentation doesn't cover.
References
N/A

Thank you for submitting your topic.
After some careful consideration, it struck us that this topic may be a bit over-saturated throughout other blog sites and official documentation.
We believe this is the best way for students to build a great portfolio (for potential employers) is by building what does not exist and what can provide the most value.
Please feel free to suggest an alternate topic to explore. 🚀


How to create joins

First I'd like to thank you for your great work!
I'm working on a small project where we have quite a complex SQL query which aggregates statistics from the play and agg_play table for each game. So far I save it as csv and later have to import it to python. I'd like to skip this step and do it directly with the nfldb methods.
I tried a few things but currently I can not get it to work like I would.

I found this file https://github.com/BurntSushi/nfldb/blob/master/tests/test_sql.py but it seems that the join methods are not visible when importing nfldb. I copied join and joins_to to my source file and tried to use. But it doesn't return anything and it also doesn't change anything. But since it is in the test folder maybe it shouldn't be used?

I tried to loop over games and then over e.g. play like this.

db = nfldb.connect()
q = nfldb.Query(db)

q.game(season_year=2012, season_type='Regular')
q.player(full_name='Peyton Manning')

for g in q.as_games():
	q.play(gsis_id=g.gsis_id)
	for p in q.as_aggregate():
		features = [g.gsis_id, g.week, g.season_type, g.season_year,g.start_time, g.home_team, g.home_score, g.home_score_q1, g.home_score_q2, g.home_score_q3, g.home_score_q4,
					p.passing_tds, p.rushing_tds, p.kicking_fga, p.kicking_fgm, p.fumbles_tot, p.fumbles_lost, p.kicking_xpa]
		print '\t'.join(str(f) for f in features)

But this does not work because of course in the loop the query is set to only this game and I am not able to loop over play and play as_aggregate() in nested loops, this does not make much sense....
My desired output would be like the table in the screenshot. Do you see any way how this can be done with the nfldb library?

I have no idea if it is the most efficient but why not just create a second query once you have a single game in hand?
import nfldb

db = nfldb.connect()
q = nfldb.Query(db)

q.game(season_year=2012, season_type='Regular')
q.player(full_name='Peyton Manning')

for g in q.as_games():
    game_info = map(str, [g.gsis_id, g.week, g.season_type, g.season_year, g.start_time, g.home_team, g.home_score_q1, g.home_score_q2, g.home_score_q3, g.home_score_q4])

    new_q = nfldb.Query(db)
    new_q.game(gsis_id=g.gsis_id)
    new_q.player(full_name='Peyton Manning')
    for p in new_q.as_aggregate():
        player_info = map(str, [p.passing_tds, p.rushing_tds, p.kicking_fga, p.kicking_fgm, p.fumbles_tot, p.fumbles_lost, p.kicking_xpa])
    print game_info + player_info

['2012121606', '15', 'Regular', '2012', '2012-12-16 12:00:00-06:00', 'BAL', '0', '0', '3', '14', '1', '0', '0', '0', '0', '0', '0']
['2012101500', '6', 'Regular', '2012', '2012-10-15 19:30:00-05:00', 'SD', '10', '14', '0', '0', '3', '0', '0', '0', '0', '0', '0']
['2012111810', '11', 'Regular', '2012', '2012-11-18 15:25:00-06:00', 'DEN', '0', '17', '7', '6', '3', '0', '0', '0', '0', '0', '0']
['2012102811', '8', 'Regular', '2012', '2012-10-28 19:20:00-05:00', 'DEN', '7', '10', '7', '10', '3', '0', '0', '0', '0', '0', '0']
['2012110404', '9', 'Regular', '2012', '2012-11-04 12:00:00-06:00', 'CIN', '0', '3', '10', '10', '3', '0', '0', '0', '0', '0', '0']
['2012112504', '12', 'Regular', '2012', '2012-11-25 12:00:00-06:00', 'KC', '6', '0', '3', '0', '2', '0', '0', '0', '0', '0', '0']
['2012093008', '4', 'Regular', '2012', '2012-09-30 15:05:00-05:00', 'DEN', '10', '0', '21', '6', '3', '0', '0', '0', '0', '0', '0']
['2012090912', '1', 'Regular', '2012', '2012-09-09 19:20:00-05:00', 'DEN', '0', '7', '7', '17', '2', '0', '0', '0', '0', '0', '0']
['2012120209', '13', 'Regular', '2012', '2012-12-02 15:05:00-06:00', 'DEN', '7', '0', '21', '3', '3', '0', '0', '0', '0', '0', '0']
['2012123012', '17', 'Regular', '2012', '2012-12-30 15:25:00-06:00', 'DEN', '7', '14', '14', '3', '3', '0', '0', '0', '0', '0', '0']
['2012111100', '10', 'Regular', '2012', '2012-11-11 12:00:00-06:00', 'CAR', '7', '0', '0', '7', '1', '0', '0', '0', '1', '1', '0']
['2012092311', '3', 'Regular', '2012', '2012-09-23 15:25:00-05:00', 'DEN', '5', '6', '0', '14', '2', '0', '0', '0', '0', '0', '0']
['2012100709', '5', 'Regular', '2012', '2012-10-07 15:25:00-05:00', 'NE', '7', '10', '14', '0', '3', '0', '0', '0', '1', '1', '0']
['2012122311', '16', 'Regular', '2012', '2012-12-23 15:05:00-06:00', 'DEN', '7', '7', '7', '13', '3', '0', '0', '0', '0', '0', '0']
['2012091700', '2', 'Regular', '2012', '2012-09-17 19:30:00-05:00', 'ATL', '10', '10', '7', '0', '1', '0', '0', '0', '0', '0', '0']
['2012120600', '14', 'Regular', '2012', '2012-12-06 19:20:00-06:00', 'OAK', '0', '7', '0', '6', '1', '0', '0', '0', '0', '0', '0']

I use materialized views for weekly and season-long statistics and then add indexes on the materialized views. Here is an example for weekly targets:
CREATE MATERIALIZED VIEW cs_targets AS
WITH aggwt AS (
SELECT
pp.gsis_id, pp.player_id, pp.team, sum(pp.receiving_tar) as tar, sum(pp.receiving_rec) as rec
FROM
play_player AS pp
INNER JOIN game as g ON pp.gsis_id = g.gsis_id
WHERE g.season_type = 'Regular' AND g.season_year = 2016
GROUP BY
pp.gsis_id, pp.player_id, pp.team
)
SELECT
aggwt.gsis_id, g.season_year, g.week, aggwt.player_id, p.full_name, p.position, aggwt.team,
(CASE WHEN aggwt.team = g.home_team THEN g.away_team ELSE g.home_team END) as opp,
aggwt.tar, aggwt.rec
FROM aggwt
INNER JOIN player as p ON aggwt.player_id = p.player_id
INNER JOIN game as g ON aggwt.gsis_id = g.gsis_id
WHERE
p.position in ('RB', 'WR', 'TE')


Solution for payment gateways fee management

At level site, cart and so, the tax rules are not displayed anywhere. You see them only on amount you have to pay at PAYPAL in our tested case.
How I get here, because my first transaction was over PAYPAL and I loose 6 Pounds on fee because I don't have an option to add that fee on payment method.
So I think to a trick, to add a tax rule who would add that % to the cart. Problem is that the % Tax is not displayed on cart
So all that need some attention and correcting:

To display the TAX properly in cart
To have a solution for PayPal fee management

A simple implementation is on Tax rules level.
Create custom tax, example PayPal transaction fee, and here to have possibility to set to be used only Paypal payment method. That because if you have other payment method to not charge the client.
So you can set different fees for each payment method :))

Can you elaborate more on second issue (2) PayPal fee management?

Hi, I'll try to explain. As we all now for receiving money in Paypal we as sellers are charged some % fee.
Most shops have implemented an option for payments via Paypal, to announce and charge customer supplementary with that Paypal fee if they choose to pay via Paypal.
We need a similar option otherwise we loose money on fees (in my case I lose on one transaction more than BB month/license and is not good.
Now it's my play around situation:
Because that option is not implemented on BB, I make that trick. To add a custom tax, but the nasty part is that the custom tax is applying on all payments methods so there need an config set to witch payments method to apply the tax. It's just an idea.
At BB implementing it's more normal that payment method to have that option to add the processing fee.
On the other side, the idea of more configurable custom taxes may be very useful on different situations.

So what we need is something like "when pay with PayPal, additional charge applies", right?
If so, I'm agree in it.

A fair word of warning: PayPal's terms prohibit charging money to let people pay with PayPal. Some still do, but having the feature may give off a wrong signal.

@i7Grendel is right. Excerpt from PayPal User Agreement:
4.6 No Surcharges. You agree that you will not impose a surcharge or any other fee for accepting PayPal as a payment method. You may charge a handling fee in connection with the sale of goods or services as long as the handling fee does not operate as a surcharge and is not higher than the handling fee you charge for non-PayPal transactions.


Register

@JuliaRegistrator register
Register new SolverLogging package that facilitates hierarchical, tabularized logging for optimization (or similar) solvers.

@JuliaRegistrator register

Registration pull request created: JuliaRegistries/General/14215
After the above pull request is merged, it is recommended that a tag is created on this repository for the registered package version.
This will be done automatically if the Julia TagBot GitHub Action is installed, or can be done manually through the github interface, or via:
git tag -a v0.1.0 -m "<description of version>" 52a3730e244afb4baec17713cca98ee27162ce2c
git push origin v0.1.0

@JuliaRegistrator register
Updated compat entries

Registration pull request updated: JuliaRegistries/General/14215
After the above pull request is merged, it is recommended that a tag is created on this repository for the registered package version.
This will be done automatically if the Julia TagBot GitHub Action is installed, or can be done manually through the github interface, or via:
git tag -a v0.1.0 -m "<description of version>" 296ca00e1ff52babd16b984a4603241c0bfc9d0a
git push origin v0.1.0


LH-Bonding: refresh balance after bond/unbond/claim/withdraw

After I successfully bond, unbond or withdraw, the balance in the dashboard does not update - even though the balance in the "bond" or "unbond" component does update.


CocoaPods 1.13.0

Hey @fkorotkov, could we please update the Sonoma runners with CocoaPods 1.13.0? There are some crucial fixes in there for Flutter apps. Thank you!

Re-ran the task to release it. Should be available in 30ish minutes.

Oh @fkorotkov could you please check on that deploy? I think it may have failed.

Should be up now 👌


Add omnifocus extension

Description
Allow to perform basic actions against an OmniFocus databse:

Add a task to the inbox (with only a name)
List the inbox content

See some meta
Open the task in OmniFocus
Mark as complete
Mark as drop

More advanced task creation

Screencast

https://youtu.be/IKDUw9MKl-k
Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

@pernielsentikaer Thank  you for review 🤘
I made the change. I'll add another screencast ASAP w/ the changes.


Implement location on post review

To make it simpler for user. they can review on log in but need to select a location

done


Can you guy update this code gen title to fit on gocritic , not a big deal but it will be get better format.

https://github.com/swaggo/swag/blob/0e2ec6ccb687ad91e20d33f4e433c460ca41acaa/gen/gen.go#L433-L436
https://go-critic.com/overview.html#codegencomment

 var packageTemplate = `// Code generated by SWAG. DO NOT EDIT
 // Package {{.PackageName}}
 // This file was generated by swaggo/swag{{ if .GeneratedTime }} at
 // {{ .Timestamp }}{{ end }}
 package {{.PackageName}}


Downloader component of Managed Cloud SDK.

First part of the Cloud SDK manager code is the downloader. The first few PRs will all just be generic functionality to keep commits small. Once that's done, we'll stitch it all together.

@coollog @nkibler anything else? If not, gonna submit.


Support for Windows and Mac

Is your feature request related to a problem? Please describe.
Running this on a Windows and Mac is not supported:

Describe the solution you'd like
Either support Windows and Mac or document on readme that this action only supports Linux.
Describe alternatives you've considered
The current alternative is to find another Github action to use 😇

@Gakk (and @ismael-gobernado-deltatre) This is a limitation that is present in the current Github docker actions (see the Github action documentation). I can, however, easily add Windows and Mac support by converting this action into a composite action. What do you think?
I have more pressing deadlines before the new year, but I can release this composite version on https://github.com/rickstaa/action-create-tag-composite somewhere at the start of the new year. 🚀

Thanks for your response @rickstaa.
Instead of using an action I went with just using the GIT command line:
    - name: Tag published version
      run: |
        git tag -a v${{ needs.build.outputs.versionTag }} -m "Published version ${{ needs.build.outputs.versionTag }}" ${GITHUB_SHA}
        git push origin v${{ needs.build.outputs.versionTag }}

If you would like to convert your action into a composite action that is up to you, and thank you for being willing to do so, but I think I will keep using the simple command anyway now that it is implemented.

Thanks for your response @rickstaa.
Instead of using an action I went with just using the GIT command line:
    - name: Tag published version
      run: |
        git tag -a v${{ needs.build.outputs.versionTag }} -m "Published version ${{ needs.build.outputs.versionTag }}" ${GITHUB_SHA}
        git push origin v${{ needs.build.outputs.versionTag }}

If you would like to convert your action into a composite action, that is up to you, and thank you for being willing to do so, but I think I will keep using the simple command anyway now that it is implemented.

Thanks for letting me know! Yea, the command line is the best way I have used it myself in some projects. Maybe I will document this option instead of creating a composite action. 🤔 If it's okay with you, I would like to keep this issue open for a bit so that I don't forget. 👍🏻

If it's okay with you, I would like to keep this issue open for a bit so that I don't forget. 👍🏻

Please keep it open until documented 🙂👍

@Gakk I documented this in https://github.com/rickstaa/action-create-tag/releases/tag/v1.5.4 as I currently do not have the time to create a branch with a composite version of this action. If somebody wants to take this on in the future, feel free to create a PR. 👍🏻


Fix requests with german culture

The date fields where send in the wrong format, if the application runs with german culture.
Also fixed the SQLExpressionField. Added the value property to the request.

Thanks for the PR I will take a look at it when I get the chance to do, busy work week

For your information
If you run your tests, without my modifications, you will see an error in the method 'FetchDataAsync_should_export_data_contain_all_known_data_types_from_the_mockaroo_restful_service()', cause the service expected a value property for the SQLExpressionField.
The other tests will only fail, if you change your culture to 'de-DE'.

I will publish the changes to nuget later today. I just want update the build scripts.


Update openjdk-16 to openjdk-17

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


replacing all the sequence by choice

The order is never important in the declaration

@mikeSimonson can you cherry-pick just your last two commits and force-push please?

What branch should I make the PR against ?

Still develop.


Fix cockroachdb lock table regression

In the 6.5 release go migrations started using LOCK TABLE which is not supported by CockroachDB (2.1.6).
This PR makes sure the the latest changes can still be used with CockroachDB.
Note: Let me know if you're interested in having all the tests run on cockroachDB as well.

Note: Let me know if you're interested in having all the tests run on cockroachDB as well.

Would be nice if that is not too much trouble.

@vmihailenco fixed.
The branch is testable in my fork with go modules  require( github.com/bithavoc/migrations master-fix-lock-table-crdb) since it needs to ignore stack frames from /bithavoc/migrations when interring migration names.
About the CockroachDB support in TravisCI, I'll send it in a separate PR cool?

I'll send it in a separate PR cool?

Sure, thanks


Gui: text and layout of recovery screen fix #265

Fix issue #265 + small UX improvements.
I rollbacked rustfmt @edouardparis can you see if it makes ~100changes on your side too ?

Fix CI by doing "rustfmt"
@edouardparis it was not on my side only

Weird I dont have any change with cargo fmt --all -- --check on master, neither with this PR.
liana/gui on master [$] is 📦 v0.1.0 via 🦀 v1.65.0
❯ rustup component add rustfmt
info: component 'rustfmt' for target 'x86_64-unknown-linux-gnu' is up to date

PR is good tho


Discussion: Cortex.cpp CLI Syntax Convention

What is the syntax convention for our CLI?
CLI Syntax

Method names

Follows OpenAI API: cortex models get
Follows Docker: cortex models pull

The order of method vs required parameters

cortex models set <param>
cortex models <param> set

Command Chains

cortex run <model_id>: what sequence of calls does it make?
What other chaining do we have?
Do we automatically start engines based on the model?

What is the syntax convention for our CLI?
CLI Syntax

Method names

Follows OpenAI API: cortex models get
Follows Docker: cortex models pull

The order of method vs required parameters

cortex models set <param>
cortex models <param> set

Command Chains

cortex run <model_id>: what sequence of calls does it make?
What other chaining do we have?
Do we automatically start engines based on the model?

CLI Syntax

Method names

Follows Docker: cortex models pull
We also support cortex models get to get local model information that we have already pulled

The order of method vs required parameters

cortex models set <param>

Command Chains

cortex run <model_id>: what sequence of calls does it make?
If model does not exist, pull model: cortex models pull <model_id>
If engine does not exist, pull engine: cortex engines <engine_name> install
Start model: cortex models start <model_id>
Start chat: cortex chat <model_id> -m <msg>
What other chaining do we have?
We only have run command
Do we automatically start engines based on the model?
Yes, we do


sync --links not working

What happened:
Created a volume and synced directory tree using juicefs sync --links  data/  /mnt/ and symlink was followed instead of copying the link.
What you expected to happen:
the symlink should be copied, and not the files / directories the link is pointing to.
How to reproduce it (as minimally and precisely as possible):
# create volume
juicefs format sqlite3://test1.db test1
juicefs mount sqlite3://test1.db /mnt/

Create directory tree
mkdir -p data/dir{1,2}/sub{1,2}
touch  data/dir{1,2}/sub{1,2}/file.txt
ln -sT ../dir2 data/dir1/link-to-dir2

data/
├── dir1
│   ├── link-to-dir2 -> ../dir2
│   ├── sub1
│   │   └── file.txt
│   └── sub2
│       └── file.txt
└── dir2
    ├── sub1
    │   └── file.txt
    └── sub2
        └── file.txt

Sync the tree
juicefs sync --links -v  ./data/ /mnt/

2023/07/25 06:24:32.991438 juicefs[3676] : maxprocs: Leaving GOMAXPROCS=16: CPU quota undefined [maxprocs.go:47]
2023/07/25 06:24:32.991637 juicefs[3676] : Creating file storage at endpoint /root/data/ [object_storage.go:171]
2023/07/25 06:24:32.991669 juicefs[3676] : Ensure directory /root/data/ [file.go:339]
2023/07/25 06:24:32.991753 juicefs[3676] : Creating file storage at endpoint /mnt/ [object_storage.go:171]
2023/07/25 06:24:32.991774 juicefs[3676] : Ensure directory /mnt/ [file.go:339]
2023/07/25 06:24:32.992282 juicefs[3676] : Syncing from file:///root/data/ to file:///mnt/ [sync.go:1043]
2023/07/25 06:24:32.992304 juicefs[3676] : maxResults: 1000, defaultPartSize: 5242880, maxBlock: 10485760 [sync.go:642]
2023/07/25 06:24:32.992317 juicefs[3676] : Iterating objects from file:///root/data/ with prefix  start "" [sync.go:78]
2023/07/25 06:24:32.992342 juicefs[3676] : Listing objects from file:///root/data/ marker "" [sync.go:107]
2023/07/25 06:24:32.992467 juicefs[3676] : Iterating objects from file:///mnt/ with prefix  start "" [sync.go:78]
2023/07/25 06:24:32.992491 juicefs[3676] : Listing objects from file:///mnt/ marker "" [sync.go:107]
2023/07/25 06:24:32.993361 juicefs[3676] : Ignore directory  [sync.go:670]
2023/07/25 06:24:32.993377 juicefs[3676] : Ignore directory dir1/ [sync.go:670]
2023/07/25 06:24:32.993387 juicefs[3676] : Ignore directory dir1/link-to-dir2/ [sync.go:670]
2023/07/25 06:24:32.993396 juicefs[3676] : Ignore directory dir1/link-to-dir2/sub1/ [sync.go:670]
2023/07/25 06:24:32.997861 juicefs[3676] : Ignore directory dir1/link-to-dir2/sub2/ [sync.go:670]
2023/07/25 06:24:32.997893 juicefs[3676] : Ignore directory dir1/sub1/ [sync.go:670]
2023/07/25 06:24:32.997905 juicefs[3676] : Ignore directory dir1/sub2/ [sync.go:670]
2023/07/25 06:24:32.997965 juicefs[3676] : Ignore directory dir2/ [sync.go:670]
2023/07/25 06:24:32.997994 juicefs[3676] : Ignore directory dir2/sub1/ [sync.go:670]
2023/07/25 06:24:32.998008 juicefs[3676] : Ignore directory dir2/sub2/ [sync.go:670]
2023/07/25 06:24:33.009703 juicefs[3676] : Copied data of dir2/sub1/file.txt (0 bytes) in 11.678581ms [sync.go:496]
2023/07/25 06:24:33.019047 juicefs[3676] : Copied data of dir2/sub2/file.txt (0 bytes) in 20.990363ms [sync.go:496]
2023/07/25 06:24:33.022896 juicefs[3676] : Copied data of dir1/sub2/file.txt (0 bytes) in 24.866996ms [sync.go:496]
2023/07/25 06:24:33.026201 juicefs[3676] : Copied data of dir1/sub1/file.txt (0 bytes) in 28.278249ms [sync.go:496]
2023/07/25 06:24:33.035203 juicefs[3676] : Copied data of dir1/link-to-dir2/sub2/file.txt (0 bytes) in 37.232772ms [sync.go:496]
2023/07/25 06:24:33.036853 juicefs[3676] : Copied data of dir1/link-to-dir2/sub1/file.txt (0 bytes) in 38.955005ms [sync.go:496]
2023/07/25 06:24:33.039419 juicefs[3676] : Found: 6, skipped: 0, copied: 6 (0 B), failed: 0 [sync.go:1082]

root@ms199:~# tree /mnt/
/mnt/
├── dir1
│   ├── link-to-dir2
│   │   ├── sub1
│   │   │   └── file.txt
│   │   └── sub2
│   │       └── file.txt
│   ├── sub1
│   │   └── file.txt
│   └── sub2
│       └── file.txt
└── dir2
    ├── sub1
    │   └── file.txt
    └── sub2
        └── file.txt

10 directories, 6 files

Anything else we need to know?
Environment:

JuiceFS version (use juicefs --version) or Hadoop Java SDK version:  juicefs version 1.1.0-dev+2023-07-24.c924609
Cloud provider or hardware configuration running JuiceFS:
OS (e.g cat /etc/os-release): Debian GNU/Linux 12 (bookworm)
Kernel (e.g. uname -a): Linux ms199 6.2.16-4-pve # 1 SMP PREEMPT_DYNAMIC PVE 6.2.16-4 (2023-07-07T04:22Z) x86_64 GNU/Linux
Object storage (cloud provider and region, or self maintained): file
Metadata engine info (version, cloud provider managed or self maintained):  sqlite3
Network connectivity (JuiceFS to metadata engine, JuiceFS to object storage): N/A
Others:

We will fix it.

Thanks @zhijian-pro
Just noting here a few things to ensure is handled correctly as I ended up yesterday with a large invalid tree.

If the destination file exists and is a directory, throw an error if it attempts to replace that directory with a symlink.
If using the --delete-dst option in combination with --links first remove, then delete the destination dir and replace with the symlink.

Another point, if syncing from jfs to another storage like s3 using --links currently it gives a message
<WARNING>: storage s3://*****.s3.amazonaws.com/path/ does not support symlink, ignore it [sync.go:340]

We should make sure not to copy the tree referenced by the symlink.
Would be nice if jfs can implement a custom object with an metadata similar to how s3fs using x-amz-meta-mode
same concept can be applied to permissions https://github.com/s3fs-fuse/s3fs-fuse/blob/faec0d9d15dc0c0c48ed06e06d02b7471521d072/src/s3fs.cpp#L2002

If the destination file exists and is a directory, throw an error if it attempts to replace that directory with a symlink.

This is expected behavior because deleting a directory directly is too risky.
When such an error occurs, the user can manually delete the directory and run it again.

@ar45

If the destination file exists and is a directory, throw an error if it attempts to replace that directory with a symlink.

This is expected behavior because deleting a directory directly is too risky. When such an error occurs, the user can manually delete the directory and run it again.

If —delete-dst with —links together, the expected behavior would be to make the DST match exactly to SRC. It would be quite difficult to clean up the target manually otherwise.


Add client to the Auth0 provider

Description
As a user of the library, it can be useful to access the client directly. This PR exposes the client to the outside.
Testing
This change is untested. Before writing a test, let's discuss if this change is OK in the first place (see Description).
Checklist

[ ] I have added documentation for new/changed functionality in this PR or in auth0.com/docs
[x] All active GitHub checks for tests, formatting, and security are passing
[x] The correct base branch is being used, if not master

Hi @lukaselmer - thanks for raising this
This has come up a few times before - and we're reluctant to expose the underlying client
It's best explained in this gist https://gist.github.com/adamjmcgrath/0ed6a04047aad16506ca24d85f1b2a5c
Closing - If you have a use case which is not covered by the gist above, let me know and we can discuss it


statsync method cound't access buffer

fs.statSync(fs.readFileSync('xxx')); // trow error  Path must be a string without null bytes

Yeah, you can't pass a buffer to statSync, that's true.  It takes a string without null bytes.


Add a SELECT_DISTINCT query variant

Minimally invasive change to add a SELECT_DISTINCT query type.
Also added a test case to show that it works as expected.

Very nice. Thanks!


Love it!

We wanted more people to see it, so I tweeted it from the @directx12 account: https://twitter.com/DirectX12/status/713063449283010560

Thank you :+1:

Hi Alessio,
I’d love to chat for a little, if you have a chance. Can you give me your “real” email address? And, I have something to send you… but I need your home or work address.
That reference card is so great. ☺
Alison
From: Alessio1989<EMAIL_ADDRESS>Sent: Thursday, March 24, 2016 11:38 AM
To: alessiot89/D3D12QuickRef<EMAIL_ADDRESS>Cc: Alison Stroll<EMAIL_ADDRESS>Subject: Re: [D3D12QuickRef] Love it! (#2)
Thank you [:+1:]
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHubhttps://github.com/alessiot89/D3D12QuickRef/issues/2#issuecomment-200963343

I sent you an email (:


Generator do not create users service if authentication providers is local.

When i attempted to create application with local authentication only, generator do not create users service.

The configuration file is no token options:
{
  "host": "localhost",
  "port": 3030,
  "postgres": "postgres://postgres:@localhost:5432/test2",
  "public": "../public/"
}

This is normal behavior? How to create a user in this case?
When I generate an application with authentication via github (or any other oauth provider), the 'user' service is created.

I know what that is. Thanks for reporting. Will fix later today.

@kulakowka fixed in v0.6.6. Sorry about that.


merge package from arlac77/npm-package-template

package.json

chore(package<EMAIL_ADDRESS>

Coverage remained the same at 70.0% when pulling be450bca0d150c168956a5114f0cb4460618f453 on template-sync-1 into d4ab99936f0113deec205dfcf5e55700b23ccd45 on master.

Coverage remained the same at 70.0% when pulling be450bca0d150c168956a5114f0cb4460618f453 on template-sync-1 into d4ab99936f0113deec205dfcf5e55700b23ccd45 on master.


Add support for nvim-treesitter

Thanks for the colorscheme it looks great! It would be helpful if it supported [nvim-treesitter[(https://github.com/nvim-treesitter/nvim-treesitter)

highlights

Added initial support in dfa8bfc , let me know if you have any suggestions ;)

Pull the latest changes and it works great thanks!


Cannot read property 'apply' of undefined

Hello everyone,
someone have a ideal about this error when try import by redis-commander:
version:
$ npm list -g redis-commander
--<EMAIL_ADDRESS>
Sample data tried to Import
SET "traefik/http/services/xtpo-services/loadBalancer/healthCheck/path" "/heathcheck"
${path}\npm\node_modules\redis-commander\node_modules\node-redis-dump\lib\node-redis-dump.js:420
                                this.getClient()[ command ].apply(this.getClient(), callArgs);
                                                           ^

TypeError: Cannot read property 'apply' of undefined
    at module.exports.<anonymous> (${path}\npm\node_modules\redis-commander\node_modules\node-redis-dump\lib\node-redis-dump.js:420:32)
    at module.exports.<anonymous> (${path}\npm\node_modules\redis-commander\node_modules\node-redis-dump\lib\node-redis-dump.js:423:4)
    at fn (${path}\npm\node_modules\redis-commander\node_modules\node-redis-dump\node_modules\async\lib\async.js:582:34)
    at Immediate.<anonymous> (${path}\npm\node_modules\redis-commander\node_modules\node-redis-dump\node_modules\async\lib\async.js:498:34)
    at processImmediate (internal/timers.js:461:21)

Hello,
cannot reproduce with latest version. Can you please install Redis Commander from git and test again?
Current master works fine. Same as Docker image
Sorry but there were no npm release for some time as its a bit difficult right now.
Best regards,
S. Seide

close as probably fixed, please reopen with instructions on how to reproduce if it is not


Highlight the uncancelable behavior in Timeout middleware scaladoc

I think the uncancelable behavior is noteworthy because it could lead to some surprising effects on the user site. It's indisputable that it's the user's responsibility to check how their services produce effects. But still, I'm sure it's better to highlight that behavior.
Also, I've added the test that proves my point about Timeout middleware behavior when dealing with uncancelable effects.

Thanks, sorry for the nitpicks. I think this is a really important topic to cover.


Paper and code

Hi, your work seems interesting，when will you release your code and paper?

Hi, I just released it.